Max level shown:
1 [ Nov 25 19:31:02 Enabled. ]
2 [ Nov 25 19:31:02 Rereading configuration. ]
3 [ Nov 25 19:31:05 Rereading configuration. ]
4 [ Nov 25 19:31:14 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Nov 25 19:31:14 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-11-25T19:31:14.993ZDEBGnexus: registered DTrace probes
82024-11-25T19:31:14.995ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:75
92024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-11-25T19:31:15.005ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
332024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
342024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
352024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
362024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
372024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
382024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
392024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
402024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
412024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
422024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
432024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
442024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
452024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
462024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
472024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
482024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
492024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
502024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
512024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
522024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
532024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
542024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
552024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
562024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
572024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
582024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
592024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
602024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
612024-11-25T19:31:15.006ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
622024-11-25T19:31:15.006ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
632024-11-25T19:31:15.022ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
642024-11-25T19:31:15.025ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
652024-11-25T19:31:15.031ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
662024-11-25T19:31:15.040ZDEBGnexus (ServerContext): registered USDT probes
672024-11-25T19:31:15.098ZINFOnexus: Database schema version is up to date desired_version = 114.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 114.0.0
682024-11-25T19:31:15.102ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1100, tv_nsec: 650791454 } })
692024-11-25T19:31:15.102ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
702024-11-25T19:31:15.104ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
712024-11-25T19:31:15.155ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
722024-11-25T19:31:15.155ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
732024-11-25T19:31:15.159ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "542b33c3-00f1-49db-90fd-bef61c86cbe8", "content-length": "26", "date": "Mon, 25 Nov 2024 19:31:14 GMT"} })
742024-11-25T19:31:15.159ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
752024-11-25T19:31:15.160ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
762024-11-25T19:31:15.193ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1100, tv_nsec: 741828740 } })
772024-11-25T19:31:15.193ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
782024-11-25T19:31:15.229ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
792024-11-25T19:31:15.229ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
802024-11-25T19:31:15.230ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a32e5ff-fa38-461a-bad6-864f3fce7b0a", "content-length": "26", "date": "Mon, 25 Nov 2024 19:31:14 GMT"} })
812024-11-25T19:31:15.230ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
822024-11-25T19:31:15.230ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
832024-11-25T19:31:15.300ZDEBGnexus (clickhouse-client): registered USDT probes id = 168735d1-10e6-4242-a3b4-4a84b624ecca
842024-11-25T19:31:15.325ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
852024-11-25T19:31:15.343ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
862024-11-25T19:31:15.344ZDEBGnexus (DataLoader): attempting to create built-in users
872024-11-25T19:31:15.344ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
882024-11-25T19:31:15.344ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
892024-11-25T19:31:15.351ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /artifacts/{kind}/{name}/{version} versions = all
902024-11-25T19:31:15.351ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks versions = all
912024-11-25T19:31:15.352ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /bgtasks/activate versions = all
922024-11-25T19:31:15.352ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
932024-11-25T19:31:15.352ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /clickhouse/policy versions = all
942024-11-25T19:31:15.352ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /clickhouse/policy versions = all
952024-11-25T19:31:15.352ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
962024-11-25T19:31:15.352ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
972024-11-25T19:31:15.352ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
982024-11-25T19:31:15.352ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
992024-11-25T19:31:15.352ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1002024-11-25T19:31:15.352ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga versions = all
1012024-11-25T19:31:15.352ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1022024-11-25T19:31:15.352ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all versions = all
1032024-11-25T19:31:15.352ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1042024-11-25T19:31:15.352ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1052024-11-25T19:31:15.352ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/import versions = all
1062024-11-25T19:31:15.352ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
1072024-11-25T19:31:15.352ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/target versions = all
1082024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/target versions = all
1092024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
1102024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1112024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /disks/{disk_id} versions = all
1122024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1132024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/collectors versions = all
1142024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1152024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/producers versions = all
1162024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1172024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /physical-disk/expunge versions = all
1182024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /probes/{sled} versions = all
1192024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1202024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas versions = all
1212024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas/{saga_id} versions = all
1222024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1232024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1242024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1252024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/add versions = all
1262024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/expunge versions = all
1272024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sleds/uninitialized versions = all
1282024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /switch/{switch_id} versions = all
1292024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1302024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1312024-11-25T19:31:15.353ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12221
1322024-11-25T19:31:15.353ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12221
1332024-11-25T19:31:15.353ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1342024-11-25T19:31:15.354ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1352024-11-25T19:31:15.367ZWARNnexus: Cannot look up rack: Object (of type ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c)) not found: rack file = nexus/src/app/rack.rs:774
1362024-11-25T19:31:15.378ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1372024-11-25T19:31:15.378ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1382024-11-25T19:31:15.379ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1392024-11-25T19:31:15.380ZDEBGnexus (DataLoader): attempting to create built-in roles
1402024-11-25T19:31:15.380ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1412024-11-25T19:31:15.380ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1422024-11-25T19:31:15.388ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1432024-11-25T19:31:15.388ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1442024-11-25T19:31:15.389ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1452024-11-25T19:31:15.389ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1462024-11-25T19:31:15.389ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1472024-11-25T19:31:15.389ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1482024-11-25T19:31:15.434ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1492024-11-25T19:31:15.434ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1502024-11-25T19:31:15.435ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1512024-11-25T19:31:15.435ZDEBGnexus (DataLoader): attempting to create built-in silos
1522024-11-25T19:31:15.435ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1532024-11-25T19:31:15.436ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1542024-11-25T19:31:15.482ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1552024-11-25T19:31:15.482ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1562024-11-25T19:31:15.483ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1572024-11-25T19:31:15.500ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1582024-11-25T19:31:15.501ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1592024-11-25T19:31:15.501ZDEBGnexus (DataLoader): attempting to create built-in projects
1602024-11-25T19:31:15.501ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1612024-11-25T19:31:15.501ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1622024-11-25T19:31:15.514ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1632024-11-25T19:31:15.515ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1642024-11-25T19:31:15.555ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1652024-11-25T19:31:15.555ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1662024-11-25T19:31:16.028ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1672024-11-25T19:31:16.030ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1682024-11-25T19:31:16.030ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1692024-11-25T19:31:16.030ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1702024-11-25T19:31:16.064ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1712024-11-25T19:31:16.064ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1722024-11-25T19:31:16.066ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1732024-11-25T19:31:16.067ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1742024-11-25T19:31:16.067ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1752024-11-25T19:31:16.068ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1762024-11-25T19:31:16.136ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1772024-11-25T19:31:16.136ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1782024-11-25T19:31:16.137ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1792024-11-25T19:31:16.137ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1802024-11-25T19:31:16.137ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1812024-11-25T19:31:16.137ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1822024-11-25T19:31:16.142ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1832024-11-25T19:31:16.142ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1842024-11-25T19:31:16.144ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1852024-11-25T19:31:16.144ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1862024-11-25T19:31:16.178ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1872024-11-25T19:31:16.178ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1882024-11-25T19:31:16.180ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1892024-11-25T19:31:16.180ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1902024-11-25T19:31:16.181ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1912024-11-25T19:31:16.184ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1922024-11-25T19:31:16.184ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1932024-11-25T19:31:16.184ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1942024-11-25T19:31:16.185ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1952024-11-25T19:31:16.186ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1962024-11-25T19:31:16.189ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1972024-11-25T19:31:16.189ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1982024-11-25T19:31:16.190ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1992024-11-25T19:31:16.192ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2002024-11-25T19:31:16.193ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2012024-11-25T19:31:16.193ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2022024-11-25T19:31:16.251ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2032024-11-25T19:31:16.251ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2042024-11-25T19:31:16.261ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2052024-11-25T19:31:16.261ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2062024-11-25T19:31:16.263ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2072024-11-25T19:31:16.263ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2082024-11-25T19:31:16.265ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2092024-11-25T19:31:16.268ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2102024-11-25T19:31:16.268ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2112024-11-25T19:31:16.268ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2122024-11-25T19:31:16.336ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2132024-11-25T19:31:16.336ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2142024-11-25T19:31:16.338ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2152024-11-25T19:31:16.339ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2162024-11-25T19:31:16.341ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2172024-11-25T19:31:16.341ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2182024-11-25T19:31:16.355ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2192024-11-25T19:31:16.355ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2202024-11-25T19:31:16.357ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2212024-11-25T19:31:16.357ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2222024-11-25T19:31:16.359ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2232024-11-25T19:31:16.359ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2242024-11-25T19:31:16.361ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2252024-11-25T19:31:16.361ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2262024-11-25T19:31:16.363ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2272024-11-25T19:31:16.367ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2282024-11-25T19:31:16.367ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2292024-11-25T19:31:16.367ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2302024-11-25T19:31:16.369ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2312024-11-25T19:31:16.369ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2322024-11-25T19:31:16.370ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2332024-11-25T19:31:16.371ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2342024-11-25T19:31:16.372ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2352024-11-25T19:31:16.376ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2362024-11-25T19:31:16.376ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2372024-11-25T19:31:16.376ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2382024-11-25T19:31:16.422ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2392024-11-25T19:31:16.422ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2402024-11-25T19:31:16.424ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2412024-11-25T19:31:16.424ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2422024-11-25T19:31:16.425ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2432024-11-25T19:31:16.425ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2442024-11-25T19:31:16.427ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2452024-11-25T19:31:16.430ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2462024-11-25T19:31:16.430ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2472024-11-25T19:31:16.431ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2482024-11-25T19:31:16.515ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2492024-11-25T19:31:16.515ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2502024-11-25T19:31:16.515ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2512024-11-25T19:31:16.517ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2522024-11-25T19:31:16.517ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2532024-11-25T19:31:16.519ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2542024-11-25T19:31:16.519ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2552024-11-25T19:31:16.521ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2562024-11-25T19:31:16.521ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2572024-11-25T19:31:16.522ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2582024-11-25T19:31:16.523ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2592024-11-25T19:31:16.524ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2602024-11-25T19:31:16.524ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2612024-11-25T19:31:16.526ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2622024-11-25T19:31:16.528ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2632024-11-25T19:31:16.528ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2642024-11-25T19:31:16.528ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2652024-11-25T19:31:16.530ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2662024-11-25T19:31:16.530ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2672024-11-25T19:31:16.531ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2682024-11-25T19:31:16.532ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2692024-11-25T19:31:16.533ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2702024-11-25T19:31:16.536ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2712024-11-25T19:31:16.536ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2722024-11-25T19:31:16.536ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2732024-11-25T19:31:16.538ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2742024-11-25T19:31:16.538ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2752024-11-25T19:31:16.540ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2762024-11-25T19:31:16.540ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2772024-11-25T19:31:16.542ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2782024-11-25T19:31:16.542ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2792024-11-25T19:31:16.544ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2802024-11-25T19:31:16.546ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2812024-11-25T19:31:16.546ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2822024-11-25T19:31:16.546ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2832024-11-25T19:31:16.617ZWARNnexus (datastore): Retryable transaction failure file = nexus/db-queries/src/transaction_retry.rs:159 retry_after (ms) = 48 transaction = vpc_update_firewall_rules
2842024-11-25T19:31:16.683ZINFOnexus (datastore): transaction completed attempts = 2 file = nexus/db-queries/src/transaction_retry.rs:115 transaction = vpc_update_firewall_rules
2852024-11-25T19:31:16.683ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:282
2862024-11-25T19:31:16.683ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2872024-11-25T19:31:16.683ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2882024-11-25T19:31:16.683ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2892024-11-25T19:31:16.693ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2902024-11-25T19:31:16.693ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2912024-11-25T19:31:16.694ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2922024-11-25T19:31:16.695ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2932024-11-25T19:31:16.696ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2942024-11-25T19:31:16.696ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2952024-11-25T19:31:16.698ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2962024-11-25T19:31:16.698ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2972024-11-25T19:31:16.699ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2982024-11-25T19:31:16.699ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2992024-11-25T19:31:16.701ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3002024-11-25T19:31:16.703ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3012024-11-25T19:31:16.703ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3022024-11-25T19:31:16.703ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3032024-11-25T19:31:16.706ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3042024-11-25T19:31:16.706ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3052024-11-25T19:31:16.707ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3062024-11-25T19:31:16.707ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3072024-11-25T19:31:16.708ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3082024-11-25T19:31:16.708ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3092024-11-25T19:31:16.710ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3102024-11-25T19:31:16.710ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3112024-11-25T19:31:16.711ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3122024-11-25T19:31:16.711ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3132024-11-25T19:31:16.712ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3142024-11-25T19:31:16.713ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3152024-11-25T19:31:16.714ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3162024-11-25T19:31:16.717ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
3172024-11-25T19:31:16.717ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3182024-11-25T19:31:16.718ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3192024-11-25T19:31:16.726ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3202024-11-25T19:31:16.726ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3212024-11-25T19:31:16.727ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3222024-11-25T19:31:16.727ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3232024-11-25T19:31:16.729ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3242024-11-25T19:31:16.729ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3252024-11-25T19:31:16.730ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3262024-11-25T19:31:16.733ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3272024-11-25T19:31:16.759ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3282024-11-25T19:31:16.759ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3292024-11-25T19:31:16.841ZERROnexus (DataLoader): gave up trying to populate built-in PopulateBuiltinVpcs error_message = InternalError { internal_message: "unexpected database error: Record not found" } file = nexus/src/populate.rs:126
3302024-11-25T19:31:16.841ZERROnexus: populate failed file = nexus/src/app/mod.rs:530
3312024-11-25T19:31:16.841ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:536
3322024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
3332024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
3342024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
3352024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
3362024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
3372024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
3382024-11-25T19:31:16.846ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
3392024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
3402024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
3412024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
3422024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
3432024-11-25T19:31:16.846ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
3442024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
3452024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
3462024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
3472024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
3482024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
3492024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
3502024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
3512024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
3522024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
3532024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
3542024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
3552024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
3562024-11-25T19:31:16.846ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:21:16.846465748 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
3572024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
3582024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
3592024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
3602024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
3612024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
3622024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
3632024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 374.508\u{b5}s iteration = 1 status = {"error":"no blueprint"}
3642024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
3652024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3662024-11-25T19:31:16.846ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
3672024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 631.062\u{b5}s iteration = 1 status = {"error":"no blueprint"}
3682024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
3692024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
3702024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3712024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3722024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
3732024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
3742024-11-25T19:31:16.846ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3752024-11-25T19:31:16.846ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 1.179723ms iteration = 1 status = {"error":"no config nor servers"}
3762024-11-25T19:31:16.846ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
3772024-11-25T19:31:16.846ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
3782024-11-25T19:31:16.847ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3792024-11-25T19:31:16.847ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
3802024-11-25T19:31:16.847ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
3812024-11-25T19:31:16.847ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3822024-11-25T19:31:16.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3832024-11-25T19:31:16.847ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3842024-11-25T19:31:16.847ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
3852024-11-25T19:31:16.847ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
3862024-11-25T19:31:16.847ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3872024-11-25T19:31:16.847ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
3882024-11-25T19:31:16.847ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
3892024-11-25T19:31:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
3902024-11-25T19:31:16.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
3912024-11-25T19:31:16.847ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
3922024-11-25T19:31:16.847ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
3932024-11-25T19:31:16.847ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
3942024-11-25T19:31:16.847ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
3952024-11-25T19:31:16.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
3962024-11-25T19:31:16.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3972024-11-25T19:31:16.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3982024-11-25T19:31:16.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3992024-11-25T19:31:16.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4002024-11-25T19:31:16.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4012024-11-25T19:31:16.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4022024-11-25T19:31:16.849ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4032024-11-25T19:31:16.849ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4042024-11-25T19:31:16.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4052024-11-25T19:31:16.849ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4062024-11-25T19:31:16.849ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4072024-11-25T19:31:16.849ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4082024-11-25T19:31:16.849ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4092024-11-25T19:31:16.850ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4102024-11-25T19:31:16.850ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 3.921837ms iteration = 1 status = {"error":"no config nor servers"}
4112024-11-25T19:31:16.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4122024-11-25T19:31:16.851ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1102, tv_nsec: 398981344 } })
4132024-11-25T19:31:16.851ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1102, tv_nsec: 398905163 } })
4142024-11-25T19:31:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4152024-11-25T19:31:16.851ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4162024-11-25T19:31:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4172024-11-25T19:31:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4182024-11-25T19:31:16.852ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
4192024-11-25T19:31:16.852ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4202024-11-25T19:31:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 6.531248ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4212024-11-25T19:31:16.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
4222024-11-25T19:31:16.852ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4232024-11-25T19:31:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.374945ms iteration = 1 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
4242024-11-25T19:31:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 8.12\u{b5}s iteration = 2 status = {"error":"no config"}
4252024-11-25T19:31:16.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
4262024-11-25T19:31:16.852ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4272024-11-25T19:31:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 20.001\u{b5}s iteration = 2 status = {"error":"no config"}
4282024-11-25T19:31:16.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4292024-11-25T19:31:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4302024-11-25T19:31:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
4312024-11-25T19:31:16.852ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4322024-11-25T19:31:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.923696ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4332024-11-25T19:31:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4342024-11-25T19:31:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4352024-11-25T19:31:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4362024-11-25T19:31:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4372024-11-25T19:31:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4382024-11-25T19:31:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4392024-11-25T19:31:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4402024-11-25T19:31:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4412024-11-25T19:31:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4422024-11-25T19:31:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4432024-11-25T19:31:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4442024-11-25T19:31:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4452024-11-25T19:31:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4462024-11-25T19:31:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4472024-11-25T19:31:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4482024-11-25T19:31:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4492024-11-25T19:31:16.854ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
4502024-11-25T19:31:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4512024-11-25T19:31:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4522024-11-25T19:31:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4532024-11-25T19:31:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4542024-11-25T19:31:16.855ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
4552024-11-25T19:31:16.855ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4562024-11-25T19:31:16.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4572024-11-25T19:31:16.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4582024-11-25T19:31:16.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4592024-11-25T19:31:16.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4602024-11-25T19:31:16.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4612024-11-25T19:31:16.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4622024-11-25T19:31:16.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4632024-11-25T19:31:16.866ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4642024-11-25T19:31:16.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4652024-11-25T19:31:16.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4662024-11-25T19:31:16.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4672024-11-25T19:31:16.867ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1102, tv_nsec: 415638181 } })
4682024-11-25T19:31:16.867ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
4692024-11-25T19:31:16.869ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1102, tv_nsec: 418373535 } })
4702024-11-25T19:31:16.870ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
4712024-11-25T19:31:16.883ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:21:16.846465748 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
4722024-11-25T19:31:16.883ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 37.652189ms iteration = 1 status = {"expiration":"2024-11-25T19:21:16.846465748Z","pruned":[]}
4732024-11-25T19:31:16.885ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 39.305401ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
4742024-11-25T19:31:16.889ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4752024-11-25T19:31:16.889ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
4762024-11-25T19:31:16.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4772024-11-25T19:31:16.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4782024-11-25T19:31:16.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.855805ms iteration = 1 status = {"errors":[],"records_set_to_done":[]}
4792024-11-25T19:31:16.904ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4802024-11-25T19:31:16.906ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(4cc640c1-8be3-451a-af98-2c0913656c3d, 0)]
4812024-11-25T19:31:16.907ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1102, tv_nsec: 455457822 } })
4822024-11-25T19:31:16.907ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4832024-11-25T19:31:16.907ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4842024-11-25T19:31:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4852024-11-25T19:31:16.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4862024-11-25T19:31:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
4872024-11-25T19:31:16.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4882024-11-25T19:31:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4892024-11-25T19:31:16.912ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4902024-11-25T19:31:16.913ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
4912024-11-25T19:31:16.913ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.78827ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
4922024-11-25T19:31:16.914ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
4932024-11-25T19:31:16.914ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
4942024-11-25T19:31:16.914ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 68.370321ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
4952024-11-25T19:31:16.914ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4962024-11-25T19:31:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4972024-11-25T19:31:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4982024-11-25T19:31:16.916ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4992024-11-25T19:31:16.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5002024-11-25T19:31:16.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5012024-11-25T19:31:16.918ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
5022024-11-25T19:31:16.918ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5032024-11-25T19:31:16.918ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5042024-11-25T19:31:16.918ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5052024-11-25T19:31:16.918ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5062024-11-25T19:31:16.918ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 72.931701ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5072024-11-25T19:31:16.919ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "05bb27d3-0071-487a-8dad-c78b844f24c2", "content-length": "26", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5082024-11-25T19:31:16.919ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
5092024-11-25T19:31:16.919ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 73.755157ms iteration = 1 status = {"error":"rack not yet initialized: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c"}
5102024-11-25T19:31:16.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5112024-11-25T19:31:16.920ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5122024-11-25T19:31:16.920ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5132024-11-25T19:31:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5142024-11-25T19:31:16.921ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5152024-11-25T19:31:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5162024-11-25T19:31:16.922ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5172024-11-25T19:31:16.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5182024-11-25T19:31:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5192024-11-25T19:31:16.923ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5202024-11-25T19:31:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5212024-11-25T19:31:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5222024-11-25T19:31:16.923ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5232024-11-25T19:31:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5242024-11-25T19:31:16.925ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5252024-11-25T19:31:16.925ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5262024-11-25T19:31:16.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5272024-11-25T19:31:16.925ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5282024-11-25T19:31:16.927ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5292024-11-25T19:31:16.928ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5302024-11-25T19:31:16.928ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5312024-11-25T19:31:16.928ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5322024-11-25T19:31:16.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5332024-11-25T19:31:16.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5342024-11-25T19:31:16.929ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5352024-11-25T19:31:16.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5362024-11-25T19:31:16.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5372024-11-25T19:31:16.931ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5382024-11-25T19:31:16.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5392024-11-25T19:31:16.931ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5402024-11-25T19:31:16.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5412024-11-25T19:31:16.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5422024-11-25T19:31:16.931ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
5432024-11-25T19:31:16.931ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 85.393515ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
5442024-11-25T19:31:16.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 87.13186ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
5452024-11-25T19:31:16.933ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5462024-11-25T19:31:16.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5472024-11-25T19:31:16.933ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
5482024-11-25T19:31:16.933ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5492024-11-25T19:31:16.933ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5502024-11-25T19:31:16.934ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0890c0c-e2d1-43ac-b708-8089c0f97dfb", "content-length": "26", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5512024-11-25T19:31:16.934ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5522024-11-25T19:31:16.935ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 89.334223ms iteration = 1 status = {}
5532024-11-25T19:31:16.935ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5542024-11-25T19:31:16.936ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5552024-11-25T19:31:16.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5562024-11-25T19:31:16.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5572024-11-25T19:31:16.937ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5582024-11-25T19:31:16.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5592024-11-25T19:31:16.940ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5602024-11-25T19:31:16.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5612024-11-25T19:31:16.943ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5622024-11-25T19:31:16.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5632024-11-25T19:31:16.945ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5642024-11-25T19:31:16.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5652024-11-25T19:31:16.947ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5662024-11-25T19:31:16.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5672024-11-25T19:31:16.951ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5682024-11-25T19:31:16.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5692024-11-25T19:31:16.953ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5702024-11-25T19:31:16.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5712024-11-25T19:31:16.956ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5722024-11-25T19:31:16.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5732024-11-25T19:31:16.959ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
5742024-11-25T19:31:16.959ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 113.280292ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
5752024-11-25T19:31:16.960ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
5762024-11-25T19:31:16.960ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5772024-11-25T19:31:16.960ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
5782024-11-25T19:31:16.960ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5792024-11-25T19:31:16.960ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 115.004876ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
5802024-11-25T19:31:16.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5812024-11-25T19:31:16.964ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5822024-11-25T19:31:16.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5832024-11-25T19:31:16.971ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
5842024-11-25T19:31:16.971ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
5852024-11-25T19:31:16.971ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
5862024-11-25T19:31:16.971ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5872024-11-25T19:31:16.972ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "69930e27-ff9d-4b1c-b88f-63a5e9b9f5f3", "content-length": "476", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5882024-11-25T19:31:16.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5892024-11-25T19:31:16.975ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 129.086182ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
5902024-11-25T19:31:16.975ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
5912024-11-25T19:31:16.976ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "de3757b5-de74-4c5b-8b43-334e71bb6fcd", "content-length": "734", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5922024-11-25T19:31:16.977ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
5932024-11-25T19:31:16.977ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a7fdc80-28b8-4bc2-8bff-92b0092b2646", "content-length": "111", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5942024-11-25T19:31:16.978ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
5952024-11-25T19:31:16.978ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "28b2059c-dfe6-49ef-b6e7-004e839b4877", "content-length": "111", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5962024-11-25T19:31:16.978ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
5972024-11-25T19:31:16.979ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5982024-11-25T19:31:16.979ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b537da4-672c-42dd-87bb-2a8ce2012632", "content-length": "167", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5992024-11-25T19:31:16.979ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6002024-11-25T19:31:16.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6012024-11-25T19:31:16.979ZERROnexus (BackgroundTasks): nexus is running but no service zone nat values could be generated from inventory background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:257
6022024-11-25T19:31:16.979ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 133.491749ms iteration = 1 status = {"error":"nexus is running but no service zone nat values could be generated from inventory"}
6032024-11-25T19:31:16.979ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2910c29c-0474-4266-b39a-681995defd6a", "content-length": "167", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6042024-11-25T19:31:16.980ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6052024-11-25T19:31:16.980ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "286cce94-4d1b-4150-b433-d2b5f245afaf", "content-length": "175", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6062024-11-25T19:31:16.980ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6072024-11-25T19:31:16.980ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b8d152e-af8f-4c6d-b411-22867fecc1ed", "content-length": "175", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6082024-11-25T19:31:16.980ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
6092024-11-25T19:31:16.981ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "29ad5c1f-13e2-4c40-b09c-b1f1cea63286", "content-length": "702", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6102024-11-25T19:31:16.981ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6112024-11-25T19:31:16.982ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 136.145421ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6122024-11-25T19:31:16.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6132024-11-25T19:31:16.982ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6142024-11-25T19:31:16.982ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "355f02cd-24e3-4625-8a18-848368c2ad4c", "content-length": "727", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6152024-11-25T19:31:16.982ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6162024-11-25T19:31:16.982ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdf44603-dedd-42e5-b0e7-4ad98c325413", "content-length": "729", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6172024-11-25T19:31:16.982ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6182024-11-25T19:31:16.983ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5dcb05a4-34c8-41f4-b7bf-da456a126ccd", "content-length": "728", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6192024-11-25T19:31:16.983ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
6202024-11-25T19:31:16.983ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "be0fd054-1420-4a91-bf43-325ebdbf22e7", "content-length": "722", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6212024-11-25T19:31:16.983ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
6222024-11-25T19:31:16.983ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bf4d606-9993-4082-a6dc-39a8d9e3f262", "content-length": "109", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6232024-11-25T19:31:16.983ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
6242024-11-25T19:31:16.983ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "32ab368b-4660-409a-9b66-5b70feec5352", "content-length": "109", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6252024-11-25T19:31:16.983ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
6262024-11-25T19:31:16.984ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6272024-11-25T19:31:16.984ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "333b4d5b-e3e5-44e7-b51b-ffc4208628f6", "content-length": "169", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6282024-11-25T19:31:16.984ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
6292024-11-25T19:31:16.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6302024-11-25T19:31:16.984ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfa1491b-857c-4629-9495-7a4d31142a93", "content-length": "169", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6312024-11-25T19:31:16.984ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
6322024-11-25T19:31:16.984ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "38baea88-5445-4d91-8018-4e08dab375c9", "content-length": "178", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6332024-11-25T19:31:16.984ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
6342024-11-25T19:31:16.985ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "31a0b2b8-531c-4707-af82-6706aec5b794", "content-length": "178", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6352024-11-25T19:31:16.985ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
6362024-11-25T19:31:16.985ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "46d2d2b4-fc0f-49be-bda2-6fac3e1fb177", "content-length": "702", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6372024-11-25T19:31:16.985ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6382024-11-25T19:31:16.985ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f124bc82-eb7e-4ee8-9e95-1b8016db327c", "content-length": "727", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6392024-11-25T19:31:16.985ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6402024-11-25T19:31:16.985ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "03c4cb99-7a67-44e7-b9c3-0caa556f1408", "content-length": "729", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6412024-11-25T19:31:16.985ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6422024-11-25T19:31:16.985ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "05cf6909-a8df-4b6e-81b1-63901d8d8793", "content-length": "728", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6432024-11-25T19:31:16.985ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6442024-11-25T19:31:16.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6452024-11-25T19:31:16.986ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6462024-11-25T19:31:16.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6472024-11-25T19:31:16.987ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6482024-11-25T19:31:16.987ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6492024-11-25T19:31:16.987ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2a37648-7372-46d8-a4c9-267bc5c261e1", "content-length": "1", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
6502024-11-25T19:31:16.988ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6512024-11-25T19:31:16.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6522024-11-25T19:31:16.988ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6532024-11-25T19:31:16.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6542024-11-25T19:31:16.989ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
6552024-11-25T19:31:16.989ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6562024-11-25T19:31:16.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6572024-11-25T19:31:16.990ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6582024-11-25T19:31:16.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6592024-11-25T19:31:16.990ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6602024-11-25T19:31:16.990ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 144.886562ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6612024-11-25T19:31:16.990ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6622024-11-25T19:31:16.990ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 145.073795ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
6632024-11-25T19:31:16.991ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6642024-11-25T19:31:16.993ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
6652024-11-25T19:31:16.993ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6662024-11-25T19:31:16.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6672024-11-25T19:31:16.993ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6682024-11-25T19:31:16.996ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 150.39911ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6692024-11-25T19:31:16.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6702024-11-25T19:31:16.997ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 151.37173ms iteration = 1 status = {}
6712024-11-25T19:31:16.997ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6722024-11-25T19:31:16.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6732024-11-25T19:31:16.999ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6742024-11-25T19:31:16.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6752024-11-25T19:31:17.004ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 158.231514ms iteration = 1 status = null
6762024-11-25T19:31:17.006ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6772024-11-25T19:31:17.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6782024-11-25T19:31:17.014ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6792024-11-25T19:31:17.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6802024-11-25T19:31:17.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6812024-11-25T19:31:17.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6822024-11-25T19:31:17.017ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6832024-11-25T19:31:17.017ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6842024-11-25T19:31:17.017ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 171.813801ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6852024-11-25T19:31:17.019ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6862024-11-25T19:31:17.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6872024-11-25T19:31:17.021ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6882024-11-25T19:31:17.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6892024-11-25T19:31:17.026ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 180.782587ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
6902024-11-25T19:31:17.030ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 184.728154ms iteration = 1 status = {}
6912024-11-25T19:31:17.059ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
6922024-11-25T19:31:17.059ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
6932024-11-25T19:31:17.059ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
6942024-11-25T19:31:17.061ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6952024-11-25T19:31:17.061ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6962024-11-25T19:31:17.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6972024-11-25T19:31:17.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6982024-11-25T19:31:17.063ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6992024-11-25T19:31:17.063ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7002024-11-25T19:31:17.065ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
7012024-11-25T19:31:17.065ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7022024-11-25T19:31:17.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7032024-11-25T19:31:17.067ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7042024-11-25T19:31:17.067ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7052024-11-25T19:31:17.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7062024-11-25T19:31:17.067ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7072024-11-25T19:31:17.067ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 221.934944ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7082024-11-25T19:31:17.077ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7092024-11-25T19:31:17.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7102024-11-25T19:31:17.085ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7112024-11-25T19:31:17.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7122024-11-25T19:31:17.091ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7132024-11-25T19:31:17.097ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7142024-11-25T19:31:17.097ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7152024-11-25T19:31:17.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7162024-11-25T19:31:17.114ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7172024-11-25T19:31:17.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7182024-11-25T19:31:17.117ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7192024-11-25T19:31:17.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7202024-11-25T19:31:17.119ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7212024-11-25T19:31:17.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7222024-11-25T19:31:17.132ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7232024-11-25T19:31:17.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7242024-11-25T19:31:17.135ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7252024-11-25T19:31:17.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7262024-11-25T19:31:17.137ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7272024-11-25T19:31:17.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7282024-11-25T19:31:17.173ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7292024-11-25T19:31:17.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7302024-11-25T19:31:17.175ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7312024-11-25T19:31:17.177ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7322024-11-25T19:31:17.177ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7332024-11-25T19:31:17.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7342024-11-25T19:31:17.180ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7352024-11-25T19:31:17.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7362024-11-25T19:31:17.181ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7372024-11-25T19:31:17.182ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7382024-11-25T19:31:17.183ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7392024-11-25T19:31:17.183ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7402024-11-25T19:31:17.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7412024-11-25T19:31:17.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7422024-11-25T19:31:17.187ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7432024-11-25T19:31:17.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7442024-11-25T19:31:17.188ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7452024-11-25T19:31:17.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7462024-11-25T19:31:17.190ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7472024-11-25T19:31:17.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7482024-11-25T19:31:17.192ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7492024-11-25T19:31:17.196ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7502024-11-25T19:31:17.196ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7512024-11-25T19:31:17.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7522024-11-25T19:31:17.204ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
7532024-11-25T19:31:17.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7542024-11-25T19:31:17.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7552024-11-25T19:31:17.206ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7562024-11-25T19:31:17.207ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 3cff3489-5262-460c-9672-e9e1fc276c52 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
7572024-11-25T19:31:17.207ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 3cff3489-5262-460c-9672-e9e1fc276c52 time_started = 2024-11-25 19:31:16.968387 UTC
7582024-11-25T19:31:17.207ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 362.108735ms iteration = 1 status = {"collection_id":"3cff3489-5262-460c-9672-e9e1fc276c52","time_done":"2024-11-25 19:31:17.059928 UTC","time_started":"2024-11-25 19:31:16.968387 UTC"}
7592024-11-25T19:31:17.207ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
7602024-11-25T19:31:17.207ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7612024-11-25T19:31:17.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7622024-11-25T19:31:17.208ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
7632024-11-25T19:31:17.208ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7642024-11-25T19:31:17.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7652024-11-25T19:31:17.209ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7662024-11-25T19:31:17.210ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
7672024-11-25T19:31:17.210ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
7682024-11-25T19:31:17.210ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
7692024-11-25T19:31:17.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7702024-11-25T19:31:17.211ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7712024-11-25T19:31:17.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7722024-11-25T19:31:17.213ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
7732024-11-25T19:31:17.213ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.773053ms iteration = 2 status = {"error":"rack not yet initialized: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c"}
7742024-11-25T19:31:17.264ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 418.269347ms iteration = 1 status = {}
7752024-11-25T19:31:17.325ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
7762024-11-25T19:31:17.325ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
7772024-11-25T19:31:17.325ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
7782024-11-25T19:31:17.325ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 478.05396ms
7792024-11-25T19:31:17.325ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 478.875466ms iteration = 1 status = {}
7802024-11-25T19:31:17.368ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7812024-11-25T19:31:17.368ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7822024-11-25T19:31:17.370ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7832024-11-25T19:31:17.370ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7842024-11-25T19:31:17.373ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7852024-11-25T19:31:17.376ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
7862024-11-25T19:31:17.376ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, time_created: 2024-11-25T19:31:16.865486Z, time_modified: 2024-11-25T19:31:16.865486Z }, initialized: false, tuf_base_url: None, rack_subnet: None } file = nexus/src/app/rack.rs:768
7872024-11-25T19:31:19.376ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7882024-11-25T19:31:19.377ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7892024-11-25T19:31:19.379ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7902024-11-25T19:31:19.379ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7912024-11-25T19:31:19.381ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7922024-11-25T19:31:19.383ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
7932024-11-25T19:31:19.383ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, time_created: 2024-11-25T19:31:16.865486Z, time_modified: 2024-11-25T19:31:16.865486Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
7942024-11-25T19:31:21.385ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7952024-11-25T19:31:21.385ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7962024-11-25T19:31:21.389ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7972024-11-25T19:31:21.389ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7982024-11-25T19:31:21.391ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7992024-11-25T19:31:21.393ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
8002024-11-25T19:31:21.393ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, time_created: 2024-11-25T19:31:16.865486Z, time_modified: 2024-11-25T19:31:16.865486Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8012024-11-25T19:31:23.394ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8022024-11-25T19:31:23.395ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8032024-11-25T19:31:23.397ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8042024-11-25T19:31:23.397ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8052024-11-25T19:31:23.399ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8062024-11-25T19:31:23.401ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
8072024-11-25T19:31:23.402ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, time_created: 2024-11-25T19:31:16.865486Z, time_modified: 2024-11-25T19:31:16.865486Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8082024-11-25T19:31:25.403ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8092024-11-25T19:31:25.403ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8102024-11-25T19:31:25.405ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8112024-11-25T19:31:25.405ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8122024-11-25T19:31:25.407ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8132024-11-25T19:31:25.409ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
8142024-11-25T19:31:25.409ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, time_created: 2024-11-25T19:31:16.865486Z, time_modified: 2024-11-25T19:31:16.865486Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8152024-11-25T19:31:26.845ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
8162024-11-25T19:31:26.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8172024-11-25T19:31:26.845ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
8182024-11-25T19:31:26.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8192024-11-25T19:31:26.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8202024-11-25T19:31:26.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8212024-11-25T19:31:26.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8222024-11-25T19:31:26.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8232024-11-25T19:31:26.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8242024-11-25T19:31:26.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8252024-11-25T19:31:26.853ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
8262024-11-25T19:31:26.853ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 7.330523ms iteration = 2 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
8272024-11-25T19:31:26.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8282024-11-25T19:31:26.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8292024-11-25T19:31:26.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.144097ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8302024-11-25T19:31:27.411ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8312024-11-25T19:31:27.411ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8322024-11-25T19:31:27.413ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8332024-11-25T19:31:27.413ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8342024-11-25T19:31:27.415ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8352024-11-25T19:31:27.417ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
8362024-11-25T19:31:27.417ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, time_created: 2024-11-25T19:31:16.865486Z, time_modified: 2024-11-25T19:31:16.865486Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8372024-11-25T19:31:29.418ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8382024-11-25T19:31:29.419ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8392024-11-25T19:31:29.421ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8402024-11-25T19:31:29.421ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8412024-11-25T19:31:29.423ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8422024-11-25T19:31:29.425ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
8432024-11-25T19:31:29.425ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, time_created: 2024-11-25T19:31:16.865486Z, time_modified: 2024-11-25T19:31:16.865486Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8442024-11-25T19:31:31.427ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8452024-11-25T19:31:31.427ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8462024-11-25T19:31:31.429ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8472024-11-25T19:31:31.429ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8482024-11-25T19:31:31.431ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8492024-11-25T19:31:31.434ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
8502024-11-25T19:31:31.434ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, time_created: 2024-11-25T19:31:16.865486Z, time_modified: 2024-11-25T19:31:16.865486Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8512024-11-25T19:31:33.041ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:45206
8522024-11-25T19:31:33.041ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:55065
8532024-11-25T19:31:33.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55065 req_id = 4b626732-cfc3-41a9-a4bc-306403ebf7b7 roles = RoleSet { roles: {} } uri = /sled-agents/38711855-ef69-4d79-bb75-aebd85b1280b
8542024-11-25T19:31:33.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55065 req_id = 4b626732-cfc3-41a9-a4bc-306403ebf7b7 resource = Database result = Ok(()) uri = /sled-agents/38711855-ef69-4d79-bb75-aebd85b1280b
8552024-11-25T19:31:33.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ea303477-cb7d-4ac8-84a9-a427c2d17da3 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
8562024-11-25T19:31:33.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ea303477-cb7d-4ac8-84a9-a427c2d17da3 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
8572024-11-25T19:31:33.049ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "38711855-ef69-4d79-bb75-aebd85b1280b" error_message_internal = not found: sled with id "38711855-ef69-4d79-bb75-aebd85b1280b" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 7046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55065 req_id = 4b626732-cfc3-41a9-a4bc-306403ebf7b7 response_code = 404 uri = /sled-agents/38711855-ef69-4d79-bb75-aebd85b1280b
8582024-11-25T19:31:33.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ea303477-cb7d-4ac8-84a9-a427c2d17da3 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
8592024-11-25T19:31:33.165ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:55 sled_uuid = 38711855-ef69-4d79-bb75-aebd85b1280b
8602024-11-25T19:31:33.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186709 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5f5ea83d-2871-4a53-ac1c-2c7b2b976ca5 response_code = 204 uri = /sled-agents/38711855-ef69-4d79-bb75-aebd85b1280b
8612024-11-25T19:31:33.349ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
8622024-11-25T19:31:33.349ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8632024-11-25T19:31:33.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8642024-11-25T19:31:33.351ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8652024-11-25T19:31:33.353ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
8662024-11-25T19:31:33.353ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8672024-11-25T19:31:33.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8682024-11-25T19:31:33.369ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(4cc640c1-8be3-451a-af98-2c0913656c3d, 0), (3cff3489-5262-460c-9672-e9e1fc276c52, 0), (50f178f1-acf7-478b-9ba7-68e1b53861af, 0)]
8692024-11-25T19:31:33.369ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1118, tv_nsec: 918277853 } })
8702024-11-25T19:31:33.401ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
8712024-11-25T19:31:33.401ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
8722024-11-25T19:31:33.401ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
8732024-11-25T19:31:33.401ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "be2d7a2f-5c41-44dd-a64a-a5e51b99b974", "content-length": "476", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
8742024-11-25T19:31:33.401ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
8752024-11-25T19:31:33.401ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0b5ca21-9326-4c68-8279-993eeccd9a18", "content-length": "734", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
8762024-11-25T19:31:33.402ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
8772024-11-25T19:31:33.402ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3539e46-895f-4492-bcb4-ed1881ddc026", "content-length": "111", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
8782024-11-25T19:31:33.402ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
8792024-11-25T19:31:33.402ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c492974-e576-4d0b-a857-02be592e93c9", "content-length": "111", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
8802024-11-25T19:31:33.402ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
8812024-11-25T19:31:33.402ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec506707-270e-4e4d-8da5-be2643137477", "content-length": "167", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
8822024-11-25T19:31:33.402ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
8832024-11-25T19:31:33.403ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "55900c2c-ed8e-460b-8251-f367e88d9f58", "content-length": "167", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
8842024-11-25T19:31:33.403ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
8852024-11-25T19:31:33.403ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f60a174c-266c-433b-82a9-bf164c00fc68", "content-length": "175", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
8862024-11-25T19:31:33.403ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
8872024-11-25T19:31:33.403ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c7e43d8-4c30-4d19-8204-91cb7cce2a6b", "content-length": "175", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
8882024-11-25T19:31:33.403ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
8892024-11-25T19:31:33.403ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "42a76e83-ed63-4576-8194-2adcee6c5508", "content-length": "702", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
8902024-11-25T19:31:33.403ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8912024-11-25T19:31:33.403ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0f38cd3-c309-45d8-a311-a6a94846e38a", "content-length": "727", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
8922024-11-25T19:31:33.404ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8932024-11-25T19:31:33.404ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "61284fc0-8231-4536-a528-439aed1c47c7", "content-length": "729", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
8942024-11-25T19:31:33.404ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8952024-11-25T19:31:33.404ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9f2e974-427a-4cd3-936e-17eee9f3647d", "content-length": "728", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
8962024-11-25T19:31:33.404ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
8972024-11-25T19:31:33.404ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d79bb0e-cc00-4b70-af14-d008b6bf03d8", "content-length": "722", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
8982024-11-25T19:31:33.404ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
8992024-11-25T19:31:33.404ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbbe8785-f2d7-4838-ae7e-d51c604b4a02", "content-length": "109", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
9002024-11-25T19:31:33.404ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
9012024-11-25T19:31:33.405ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c53173af-c157-443c-bd7a-c93b8237b351", "content-length": "109", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
9022024-11-25T19:31:33.405ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
9032024-11-25T19:31:33.405ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd90a21a-e8d3-43cc-bf2a-f012af74ec1d", "content-length": "169", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
9042024-11-25T19:31:33.405ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
9052024-11-25T19:31:33.405ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e345c332-8ec6-4a7c-908a-8e7a877e4a21", "content-length": "169", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
9062024-11-25T19:31:33.405ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
9072024-11-25T19:31:33.405ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "53402a2d-40f7-424b-a904-0f434d4119ba", "content-length": "178", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
9082024-11-25T19:31:33.405ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
9092024-11-25T19:31:33.406ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd82c0a8-502d-4a2b-94f1-ede28fce086e", "content-length": "178", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
9102024-11-25T19:31:33.406ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
9112024-11-25T19:31:33.406ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8eee21e-7ffc-450e-8a91-7b229ef33247", "content-length": "702", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
9122024-11-25T19:31:33.406ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
9132024-11-25T19:31:33.406ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f43a78e8-dadc-4d6a-9767-fcb9242a2213", "content-length": "727", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
9142024-11-25T19:31:33.406ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
9152024-11-25T19:31:33.406ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a89252a8-2500-4513-8b0d-b5f971f7d3df", "content-length": "729", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
9162024-11-25T19:31:33.406ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
9172024-11-25T19:31:33.406ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b73bd65-40ef-4214-88f0-e712fe7bf020", "content-length": "728", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
9182024-11-25T19:31:33.406ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9192024-11-25T19:31:33.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9202024-11-25T19:31:33.408ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9212024-11-25T19:31:33.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
9222024-11-25T19:31:33.410ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9232024-11-25T19:31:33.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9242024-11-25T19:31:33.411ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9252024-11-25T19:31:33.413ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
9262024-11-25T19:31:33.413ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9272024-11-25T19:31:33.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9282024-11-25T19:31:33.435ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9292024-11-25T19:31:33.435ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9302024-11-25T19:31:33.436ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9312024-11-25T19:31:33.436ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9322024-11-25T19:31:33.437ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9332024-11-25T19:31:33.440ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
9342024-11-25T19:31:33.440ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, time_created: 2024-11-25T19:31:16.865486Z, time_modified: 2024-11-25T19:31:16.865486Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9352024-11-25T19:31:33.995ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
9362024-11-25T19:31:33.995ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
9372024-11-25T19:31:34.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2163110d-6142-483b-aae8-4d24a203af2d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
9382024-11-25T19:31:34.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2163110d-6142-483b-aae8-4d24a203af2d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
9392024-11-25T19:31:34.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2163110d-6142-483b-aae8-4d24a203af2d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
9402024-11-25T19:31:34.216ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "8240c3a1-474e-46cc-bf98-dd9103359844", "content-length": "30747", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
9412024-11-25T19:31:34.218ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
9422024-11-25T19:31:34.218ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
9432024-11-25T19:31:34.218ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
9442024-11-25T19:31:34.220ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9452024-11-25T19:31:34.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9462024-11-25T19:31:34.222ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9472024-11-25T19:31:34.224ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9482024-11-25T19:31:34.224ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9492024-11-25T19:31:34.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9502024-11-25T19:31:34.398ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 11c9f838-30d8-4855-9f92-f2b664ec0890 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
9512024-11-25T19:31:34.398ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 11c9f838-30d8-4855-9f92-f2b664ec0890 time_started = 2024-11-25 19:31:33.401135 UTC
9522024-11-25T19:31:34.398ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.0489423s iteration = 2 status = {"collection_id":"11c9f838-30d8-4855-9f92-f2b664ec0890","time_done":"2024-11-25 19:31:34.218971 UTC","time_started":"2024-11-25 19:31:33.401135 UTC"}
9532024-11-25T19:31:34.398ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
9542024-11-25T19:31:34.398ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9552024-11-25T19:31:34.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9562024-11-25T19:31:34.400ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9572024-11-25T19:31:34.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9582024-11-25T19:31:34.402ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9592024-11-25T19:31:34.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9602024-11-25T19:31:34.405ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9612024-11-25T19:31:34.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9622024-11-25T19:31:34.407ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9632024-11-25T19:31:34.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9642024-11-25T19:31:34.409ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9652024-11-25T19:31:34.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9662024-11-25T19:31:34.459ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 60.64ms iteration = 3 status = {"physical_disks_added":0}
9672024-11-25T19:31:35.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad806383-8f9c-41fc-bd80-b249e83ba835 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
9682024-11-25T19:31:35.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad806383-8f9c-41fc-bd80-b249e83ba835 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
9692024-11-25T19:31:35.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad806383-8f9c-41fc-bd80-b249e83ba835 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
9702024-11-25T19:31:35.441ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9712024-11-25T19:31:35.442ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9722024-11-25T19:31:35.443ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9732024-11-25T19:31:35.443ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9742024-11-25T19:31:35.445ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9752024-11-25T19:31:35.448ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
9762024-11-25T19:31:35.448ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
9772024-11-25T19:31:35.448ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9782024-11-25T19:31:35.448ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9792024-11-25T19:31:35.449ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9802024-11-25T19:31:35.450ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9812024-11-25T19:31:35.451ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9822024-11-25T19:31:35.451ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9832024-11-25T19:31:35.455ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9842024-11-25T19:31:35.456ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9852024-11-25T19:31:35.457ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9862024-11-25T19:31:35.457ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9872024-11-25T19:31:35.458ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9882024-11-25T19:31:35.458ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9892024-11-25T19:31:35.460ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9902024-11-25T19:31:35.463ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
9912024-11-25T19:31:35.463ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9922024-11-25T19:31:35.463ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9932024-11-25T19:31:35.464ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9942024-11-25T19:31:35.464ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9952024-11-25T19:31:35.465ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9962024-11-25T19:31:35.466ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9972024-11-25T19:31:35.466ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9982024-11-25T19:31:35.469ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
9992024-11-25T19:31:35.469ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10002024-11-25T19:31:35.469ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10012024-11-25T19:31:35.471ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10022024-11-25T19:31:35.471ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10032024-11-25T19:31:35.472ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10042024-11-25T19:31:35.473ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10052024-11-25T19:31:35.474ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10062024-11-25T19:31:35.474ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10072024-11-25T19:31:35.475ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10082024-11-25T19:31:35.475ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10092024-11-25T19:31:35.476ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10102024-11-25T19:31:35.476ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10112024-11-25T19:31:35.478ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10122024-11-25T19:31:35.478ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10132024-11-25T19:31:35.479ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10142024-11-25T19:31:35.481ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
10152024-11-25T19:31:35.481ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10162024-11-25T19:31:35.482ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10172024-11-25T19:31:35.483ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10182024-11-25T19:31:35.483ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10192024-11-25T19:31:35.484ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10202024-11-25T19:31:35.484ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10212024-11-25T19:31:35.486ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10222024-11-25T19:31:35.486ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10232024-11-25T19:31:35.488ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10242024-11-25T19:31:35.488ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10252024-11-25T19:31:35.489ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10262024-11-25T19:31:35.489ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10272024-11-25T19:31:35.490ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10282024-11-25T19:31:35.490ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10292024-11-25T19:31:35.492ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10302024-11-25T19:31:35.495ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
10312024-11-25T19:31:35.495ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10322024-11-25T19:31:35.495ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10332024-11-25T19:31:35.496ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10342024-11-25T19:31:35.496ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10352024-11-25T19:31:35.497ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10362024-11-25T19:31:35.497ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10372024-11-25T19:31:35.498ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10382024-11-25T19:31:35.501ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
10392024-11-25T19:31:35.501ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10402024-11-25T19:31:35.501ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10412024-11-25T19:31:35.506ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10422024-11-25T19:31:35.506ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10432024-11-25T19:31:35.507ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10442024-11-25T19:31:35.507ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10452024-11-25T19:31:35.509ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10462024-11-25T19:31:35.509ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10472024-11-25T19:31:35.511ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10482024-11-25T19:31:35.511ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10492024-11-25T19:31:35.512ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10502024-11-25T19:31:35.513ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10512024-11-25T19:31:35.514ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10522024-11-25T19:31:35.514ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10532024-11-25T19:31:35.515ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10542024-11-25T19:31:35.515ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10552024-11-25T19:31:35.516ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10562024-11-25T19:31:35.519ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
10572024-11-25T19:31:35.519ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10582024-11-25T19:31:35.519ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10592024-11-25T19:31:35.520ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10602024-11-25T19:31:35.520ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10612024-11-25T19:31:35.521ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10622024-11-25T19:31:35.521ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10632024-11-25T19:31:35.522ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10642024-11-25T19:31:35.525ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
10652024-11-25T19:31:35.525ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10662024-11-25T19:31:35.525ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10672024-11-25T19:31:35.531ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
10682024-11-25T19:31:35.531ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10692024-11-25T19:31:35.531ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10702024-11-25T19:31:35.532ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10712024-11-25T19:31:35.534ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
10722024-11-25T19:31:35.534ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10732024-11-25T19:31:35.534ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10742024-11-25T19:31:35.535ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
10752024-11-25T19:31:35.537ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
10762024-11-25T19:31:35.537ZDEBGnexus (InternalApi): resolved 2 rules for sleds
10772024-11-25T19:31:35.616ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 38711855-ef69-4d79-bb75-aebd85b1280b, time_created: 2024-11-25T19:31:33.165388Z, time_modified: 2024-11-25T19:31:33.165388Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
10782024-11-25T19:31:35.616ZDEBGnexus (InternalApi): sending firewall rules to sled agents
10792024-11-25T19:31:35.616ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10802024-11-25T19:31:35.616ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10812024-11-25T19:31:35.619ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10822024-11-25T19:31:35.619ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10832024-11-25T19:31:35.620ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10842024-11-25T19:31:35.622ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
10852024-11-25T19:31:35.653ZDEBGnexus (InternalApi): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
10862024-11-25T19:31:35.654ZDEBGnexus (InternalApi): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "a4bd9ea3-172a-4bcc-8de4-0dfae5dfeae0", "date": "Mon, 25 Nov 2024 19:31:35 GMT"} })
10872024-11-25T19:31:35.654ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
10882024-11-25T19:31:35.654ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
10892024-11-25T19:31:36.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f404fdc0-9519-4202-bcdb-d2d7cffabcf7 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
10902024-11-25T19:31:36.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f404fdc0-9519-4202-bcdb-d2d7cffabcf7 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
10912024-11-25T19:31:36.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f404fdc0-9519-4202-bcdb-d2d7cffabcf7 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
10922024-11-25T19:31:36.846ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
10932024-11-25T19:31:36.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10942024-11-25T19:31:36.846ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
10952024-11-25T19:31:36.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10962024-11-25T19:31:36.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10972024-11-25T19:31:36.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10982024-11-25T19:31:36.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10992024-11-25T19:31:36.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11002024-11-25T19:31:36.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11012024-11-25T19:31:36.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11022024-11-25T19:31:36.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11032024-11-25T19:31:36.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11042024-11-25T19:31:36.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11052024-11-25T19:31:36.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11062024-11-25T19:31:36.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11072024-11-25T19:31:36.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
11082024-11-25T19:31:36.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11092024-11-25T19:31:36.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11102024-11-25T19:31:36.871ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
11112024-11-25T19:31:36.871ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
11122024-11-25T19:31:36.871ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
11132024-11-25T19:31:36.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.37\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
11142024-11-25T19:31:36.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.123612ms iteration = 3 status = {"enabled":false,"status":"first target blueprint","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z","time_found":"2024-11-25T19:31:36.871158410Z"}
11152024-11-25T19:31:36.871ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
11162024-11-25T19:31:36.871ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11172024-11-25T19:31:36.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11182024-11-25T19:31:36.871ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11192024-11-25T19:31:36.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11202024-11-25T19:31:36.871ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11212024-11-25T19:31:36.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11222024-11-25T19:31:36.871ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11232024-11-25T19:31:36.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11242024-11-25T19:31:36.871ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11252024-11-25T19:31:36.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11262024-11-25T19:31:36.873ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11272024-11-25T19:31:36.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11282024-11-25T19:31:36.875ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11292024-11-25T19:31:36.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11302024-11-25T19:31:36.875ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11312024-11-25T19:31:36.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11322024-11-25T19:31:36.877ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11332024-11-25T19:31:36.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11342024-11-25T19:31:36.877ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11352024-11-25T19:31:36.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.998878ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11362024-11-25T19:31:36.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11372024-11-25T19:31:36.880ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11382024-11-25T19:31:36.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11392024-11-25T19:31:36.880ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11402024-11-25T19:31:36.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11412024-11-25T19:31:36.881ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11422024-11-25T19:31:36.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11432024-11-25T19:31:36.882ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11442024-11-25T19:31:36.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11452024-11-25T19:31:36.883ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11462024-11-25T19:31:36.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11472024-11-25T19:31:36.917ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
11482024-11-25T19:31:36.949ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
11492024-11-25T19:31:36.981ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
11502024-11-25T19:31:37.014ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
11512024-11-25T19:31:37.046ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
11522024-11-25T19:31:37.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1fc309d9-2eb4-4843-90bb-b5469c9b8508 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
11532024-11-25T19:31:37.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1fc309d9-2eb4-4843-90bb-b5469c9b8508 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
11542024-11-25T19:31:37.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1fc309d9-2eb4-4843-90bb-b5469c9b8508 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
11552024-11-25T19:31:37.275ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:45112
11562024-11-25T19:31:37.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = eb3a4b94-f2a2-42c7-a6d0-d145f220c411 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
11572024-11-25T19:31:37.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = eb3a4b94-f2a2-42c7-a6d0-d145f220c411 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
11582024-11-25T19:31:37.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = eb3a4b94-f2a2-42c7-a6d0-d145f220c411 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
11592024-11-25T19:31:37.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 66445464-c5be-4e63-838f-4b752a3e71dd roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIzODcxMTg1NS1lZjY5LTRkNzktYmI3NS1hZWJkODViMTI4MGIifX0%3D
11602024-11-25T19:31:37.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 66445464-c5be-4e63-838f-4b752a3e71dd resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIzODcxMTg1NS1lZjY5LTRkNzktYmI3NS1hZWJkODViMTI4MGIifX0%3D
11612024-11-25T19:31:37.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 66445464-c5be-4e63-838f-4b752a3e71dd response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIzODcxMTg1NS1lZjY5LTRkNzktYmI3NS1hZWJkODViMTI4MGIifX0%3D
11622024-11-25T19:31:37.360ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83526e09-44e4-48de-9573-e4af08eb8968", "content-length": "64", "date": "Mon, 25 Nov 2024 19:31:37 GMT"} })
11632024-11-25T19:31:37.360ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11642024-11-25T19:31:37.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11652024-11-25T19:31:37.362ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11662024-11-25T19:31:37.363ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11672024-11-25T19:31:37.363ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11682024-11-25T19:31:37.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11692024-11-25T19:31:37.379ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "817404f7-006f-4dab-9207-227029c425ff", "content-length": "64", "date": "Mon, 25 Nov 2024 19:31:37 GMT"} })
11702024-11-25T19:31:37.379ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11712024-11-25T19:31:37.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11722024-11-25T19:31:37.381ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11732024-11-25T19:31:37.382ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11742024-11-25T19:31:37.382ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11752024-11-25T19:31:37.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11762024-11-25T19:31:37.403ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4f24dd6-61ef-474c-a84c-dd3349517e4a", "content-length": "64", "date": "Mon, 25 Nov 2024 19:31:37 GMT"} })
11772024-11-25T19:31:37.403ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11782024-11-25T19:31:37.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11792024-11-25T19:31:37.405ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11802024-11-25T19:31:37.406ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11812024-11-25T19:31:37.406ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11822024-11-25T19:31:37.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11832024-11-25T19:31:37.433ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d36366f-5b18-4797-87a7-2efc2d1f2222", "content-length": "64", "date": "Mon, 25 Nov 2024 19:31:37 GMT"} })
11842024-11-25T19:31:37.433ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11852024-11-25T19:31:37.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11862024-11-25T19:31:37.435ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11872024-11-25T19:31:37.436ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11882024-11-25T19:31:37.436ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11892024-11-25T19:31:37.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11902024-11-25T19:31:37.451ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "14296d05-bb52-444c-9d0a-271fa82f4cd8", "content-length": "64", "date": "Mon, 25 Nov 2024 19:31:37 GMT"} })
11912024-11-25T19:31:37.451ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11922024-11-25T19:31:37.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11932024-11-25T19:31:37.453ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11942024-11-25T19:31:37.454ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11952024-11-25T19:31:37.454ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11962024-11-25T19:31:37.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11972024-11-25T19:31:37.462ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 591.668358ms iteration = 2 status = {"nsuccess":5}
11982024-11-25T19:31:38.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0c33e591-a031-4111-bf36-5481fbf49e30 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
11992024-11-25T19:31:38.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0c33e591-a031-4111-bf36-5481fbf49e30 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12002024-11-25T19:31:38.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0c33e591-a031-4111-bf36-5481fbf49e30 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12012024-11-25T19:31:39.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 60c908e9-de69-43e0-abc9-0f00b11e48f5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12022024-11-25T19:31:39.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 60c908e9-de69-43e0-abc9-0f00b11e48f5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12032024-11-25T19:31:39.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 60c908e9-de69-43e0-abc9-0f00b11e48f5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12042024-11-25T19:31:40.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 142203fb-8185-4c8d-a8cb-7511a5e1f9bb roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12052024-11-25T19:31:40.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 142203fb-8185-4c8d-a8cb-7511a5e1f9bb resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12062024-11-25T19:31:40.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 142203fb-8185-4c8d-a8cb-7511a5e1f9bb response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12072024-11-25T19:31:41.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8c4bd1a7-eb79-4d4e-812a-35b4f86971cc roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12082024-11-25T19:31:41.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8c4bd1a7-eb79-4d4e-812a-35b4f86971cc resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12092024-11-25T19:31:41.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8c4bd1a7-eb79-4d4e-812a-35b4f86971cc response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12102024-11-25T19:31:42.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 20852084-4015-4d4e-b812-0846c7338c77 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12112024-11-25T19:31:42.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 20852084-4015-4d4e-b812-0846c7338c77 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12122024-11-25T19:31:42.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 20852084-4015-4d4e-b812-0846c7338c77 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12132024-11-25T19:31:43.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b76d015f-ae9e-4e07-8c52-a173a98be128 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12142024-11-25T19:31:43.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b76d015f-ae9e-4e07-8c52-a173a98be128 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12152024-11-25T19:31:43.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b76d015f-ae9e-4e07-8c52-a173a98be128 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12162024-11-25T19:31:44.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 21892896-8c8e-4b13-827d-7d3b8c814c7e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12172024-11-25T19:31:44.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 21892896-8c8e-4b13-827d-7d3b8c814c7e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12182024-11-25T19:31:44.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 21892896-8c8e-4b13-827d-7d3b8c814c7e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12192024-11-25T19:31:45.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5e5d462-960d-4e5d-923b-a9e9f6b7bd28 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12202024-11-25T19:31:45.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5e5d462-960d-4e5d-923b-a9e9f6b7bd28 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12212024-11-25T19:31:45.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5e5d462-960d-4e5d-923b-a9e9f6b7bd28 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12222024-11-25T19:31:46.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1bb7471b-01b5-4f32-b4f7-12d5d235b347 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12232024-11-25T19:31:46.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1bb7471b-01b5-4f32-b4f7-12d5d235b347 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12242024-11-25T19:31:46.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1bb7471b-01b5-4f32-b4f7-12d5d235b347 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
12252024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
12262024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
12272024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
12282024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
12292024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12302024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
12312024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12322024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12332024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
12342024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12352024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
12362024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
12372024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12382024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12392024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
12402024-11-25T19:31:46.846ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
12412024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
12422024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12432024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
12442024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12452024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
12462024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
12472024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
12482024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12492024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12502024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12512024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
12522024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
12532024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12542024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
12552024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
12562024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
12572024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12582024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
12592024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
12602024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
12612024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12622024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12632024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12642024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12652024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12662024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12672024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12682024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12692024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
12702024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12712024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12722024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12732024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12742024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12752024-11-25T19:31:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
12762024-11-25T19:31:46.849ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1132, tv_nsec: 398166258 } })
12772024-11-25T19:31:46.850ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.07023ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
12782024-11-25T19:31:46.850ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
12792024-11-25T19:31:46.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12802024-11-25T19:31:46.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.121269ms iteration = 2 status = {"errors":[],"records_set_to_done":[]}
12812024-11-25T19:31:46.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12822024-11-25T19:31:46.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
12832024-11-25T19:31:46.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12842024-11-25T19:31:46.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12852024-11-25T19:31:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12862024-11-25T19:31:46.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12872024-11-25T19:31:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12882024-11-25T19:31:46.857ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12892024-11-25T19:31:46.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12902024-11-25T19:31:46.860ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12912024-11-25T19:31:46.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
12922024-11-25T19:31:46.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12932024-11-25T19:31:46.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12942024-11-25T19:31:46.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12952024-11-25T19:31:46.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12962024-11-25T19:31:46.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12972024-11-25T19:31:46.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
12982024-11-25T19:31:46.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12992024-11-25T19:31:46.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13002024-11-25T19:31:46.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13012024-11-25T19:31:46.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13022024-11-25T19:31:46.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13032024-11-25T19:31:46.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13042024-11-25T19:31:46.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13052024-11-25T19:31:46.867ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1132, tv_nsec: 415854695 } })
13062024-11-25T19:31:46.867ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
13072024-11-25T19:31:46.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13082024-11-25T19:31:46.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13092024-11-25T19:31:46.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13102024-11-25T19:31:46.870ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1132, tv_nsec: 419033448 } })
13112024-11-25T19:31:46.871ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
13122024-11-25T19:31:46.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13132024-11-25T19:31:46.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13142024-11-25T19:31:46.887ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13152024-11-25T19:31:46.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13162024-11-25T19:31:46.889ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13172024-11-25T19:31:46.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13182024-11-25T19:31:46.891ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13192024-11-25T19:31:46.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13202024-11-25T19:31:46.893ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13212024-11-25T19:31:46.893ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
13222024-11-25T19:31:46.893ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13232024-11-25T19:31:46.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13242024-11-25T19:31:46.895ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
13252024-11-25T19:31:46.895ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 49.542502ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
13262024-11-25T19:31:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13272024-11-25T19:31:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13282024-11-25T19:31:46.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13292024-11-25T19:31:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13302024-11-25T19:31:46.902ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13312024-11-25T19:31:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13322024-11-25T19:31:46.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13332024-11-25T19:31:46.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13342024-11-25T19:31:46.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13352024-11-25T19:31:46.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.736442ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
13362024-11-25T19:31:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
13372024-11-25T19:31:46.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13382024-11-25T19:31:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13392024-11-25T19:31:46.923ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
13402024-11-25T19:31:46.923ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13412024-11-25T19:31:46.923ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e8c6a45-471c-4a6c-b13b-595f962c2095", "content-length": "26", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
13422024-11-25T19:31:46.923ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13432024-11-25T19:31:46.925ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13442024-11-25T19:31:46.959ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
13452024-11-25T19:31:46.959ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13462024-11-25T19:31:46.959ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae06e7d4-0988-42a1-b8e4-8b27a82ea1e4", "content-length": "26", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
13472024-11-25T19:31:46.959ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13482024-11-25T19:31:46.960ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13492024-11-25T19:31:46.976ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
13502024-11-25T19:31:46.976ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13512024-11-25T19:31:46.976ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25f9e7f0-7f7f-4e00-a123-ae4054e2bd2a", "content-length": "26", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
13522024-11-25T19:31:46.977ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13532024-11-25T19:31:46.978ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
13542024-11-25T19:31:46.979ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
13552024-11-25T19:31:46.979ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13562024-11-25T19:31:46.980ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "46852e34-f796-4c62-a486-b50e934ae9ea", "content-length": "372", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
13572024-11-25T19:31:46.980ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13582024-11-25T19:31:46.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13592024-11-25T19:31:46.981ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13602024-11-25T19:31:46.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13612024-11-25T19:31:46.983ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 137.485167ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
13622024-11-25T19:31:46.984ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13632024-11-25T19:31:46.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13642024-11-25T19:31:46.986ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13652024-11-25T19:31:46.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
13662024-11-25T19:31:46.992ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13672024-11-25T19:31:46.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13682024-11-25T19:31:46.993ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 147.647636ms iteration = 2 status = 0
13692024-11-25T19:31:47.004ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
13702024-11-25T19:31:47.004ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 158.771974ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
13712024-11-25T19:31:47.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 169.006496ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13722024-11-25T19:31:47.017ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 171.463724ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
13732024-11-25T19:31:47.018ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13742024-11-25T19:31:47.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13752024-11-25T19:31:47.020ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13762024-11-25T19:31:47.021ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13772024-11-25T19:31:47.021ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
13782024-11-25T19:31:47.021ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13792024-11-25T19:31:47.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13802024-11-25T19:31:47.022ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13812024-11-25T19:31:47.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13822024-11-25T19:31:47.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13832024-11-25T19:31:47.026ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 180.011712ms iteration = 2 status = {}
13842024-11-25T19:31:47.035ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13852024-11-25T19:31:47.035ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e527265-71ba-47f6-858d-28319c051690", "content-length": "1", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
13862024-11-25T19:31:47.037ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13872024-11-25T19:31:47.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13882024-11-25T19:31:47.041ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 194.962825ms iteration = 2 status = null
13892024-11-25T19:31:47.041ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
13902024-11-25T19:31:47.043ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
13912024-11-25T19:31:47.044ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d8e49daa-4384-4ce6-b0d7-f0f7400bea43", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
13922024-11-25T19:31:47.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13932024-11-25T19:31:47.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13942024-11-25T19:31:47.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13952024-11-25T19:31:47.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13962024-11-25T19:31:47.048ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 202.034374ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
13972024-11-25T19:31:47.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13982024-11-25T19:31:47.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13992024-11-25T19:31:47.052ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
14002024-11-25T19:31:47.055ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14012024-11-25T19:31:47.055ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "01a6c43d-9afa-4ab6-843c-3022c61216bc", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
14022024-11-25T19:31:47.056ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 210.750945ms iteration = 2 status = {}
14032024-11-25T19:31:47.061ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14042024-11-25T19:31:47.062ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14052024-11-25T19:31:47.062ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 215.766273ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
14062024-11-25T19:31:47.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14072024-11-25T19:31:47.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14082024-11-25T19:31:47.096ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14092024-11-25T19:31:47.099ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14102024-11-25T19:31:47.099ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14112024-11-25T19:31:47.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14122024-11-25T19:31:47.127ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14132024-11-25T19:31:47.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14142024-11-25T19:31:47.133ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
14152024-11-25T19:31:47.133ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14162024-11-25T19:31:47.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14172024-11-25T19:31:47.137ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 291.302836ms iteration = 4 status = {"physical_disks_added":0}
14182024-11-25T19:31:47.145ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14192024-11-25T19:31:47.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14202024-11-25T19:31:47.147ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14212024-11-25T19:31:47.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14222024-11-25T19:31:47.149ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
14232024-11-25T19:31:47.149ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "820934af-b28c-4789-8933-fc4b7757d17d", "content-length": "134", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
14242024-11-25T19:31:47.150ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
14252024-11-25T19:31:47.150ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
14262024-11-25T19:31:47.150ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
14272024-11-25T19:31:47.150ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14282024-11-25T19:31:47.150ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14292024-11-25T19:31:47.150ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14302024-11-25T19:31:47.150ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14312024-11-25T19:31:47.150ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14322024-11-25T19:31:47.150ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14332024-11-25T19:31:47.150ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14342024-11-25T19:31:47.150ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
14352024-11-25T19:31:47.150ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14362024-11-25T19:31:47.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14372024-11-25T19:31:47.159ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
14382024-11-25T19:31:47.159ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc528712-c93b-4fe8-b529-f53ed930085f", "content-length": "2", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
14392024-11-25T19:31:47.161ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
14402024-11-25T19:31:47.161ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d91a67b3-2d4d-4e7f-ba66-f772147e4261", "content-length": "51", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
14412024-11-25T19:31:47.161ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
14422024-11-25T19:31:47.163ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14432024-11-25T19:31:47.241ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14442024-11-25T19:31:47.261ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6c19ee02-d304-4692-9d24-03ba7b92bd15", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
14452024-11-25T19:31:47.261ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
14462024-11-25T19:31:47.261ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14472024-11-25T19:31:47.261ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "92713dbf-0da1-4593-acc2-c69ed1f10872", "content-length": "682", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
14482024-11-25T19:31:47.261ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "282bf87a-8b01-4ad3-988d-b2c025eb0376", "content-length": "691", "date": "Mon, 25 Nov 2024 19:31:47 GMT"} })
14492024-11-25T19:31:47.261ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
14502024-11-25T19:31:47.261ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
14512024-11-25T19:31:47.261ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
14522024-11-25T19:31:47.261ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14532024-11-25T19:31:47.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14542024-11-25T19:31:47.262ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 416.860649ms iteration = 2 status = {}
14552024-11-25T19:31:47.302ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14562024-11-25T19:31:47.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14572024-11-25T19:31:47.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14582024-11-25T19:31:47.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14592024-11-25T19:31:47.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14602024-11-25T19:31:47.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14612024-11-25T19:31:47.322ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 475.942128ms iteration = 2 status = {}
14622024-11-25T19:31:47.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = da5a6198-39a1-4653-b154-ee3fd32900ec roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14632024-11-25T19:31:47.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = da5a6198-39a1-4653-b154-ee3fd32900ec resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14642024-11-25T19:31:47.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = da5a6198-39a1-4653-b154-ee3fd32900ec response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14652024-11-25T19:31:48.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e6e1786b-92d2-42b9-949b-96c740788591 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14662024-11-25T19:31:48.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e6e1786b-92d2-42b9-949b-96c740788591 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14672024-11-25T19:31:48.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e6e1786b-92d2-42b9-949b-96c740788591 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14682024-11-25T19:31:49.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4472588b-fc9b-4120-bdf6-f6c49645502b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14692024-11-25T19:31:49.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4472588b-fc9b-4120-bdf6-f6c49645502b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14702024-11-25T19:31:49.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4472588b-fc9b-4120-bdf6-f6c49645502b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14712024-11-25T19:31:50.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 53151858-9497-481e-ad3d-e75d9b37b431 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14722024-11-25T19:31:50.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 53151858-9497-481e-ad3d-e75d9b37b431 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14732024-11-25T19:31:50.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 53151858-9497-481e-ad3d-e75d9b37b431 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14742024-11-25T19:31:50.752ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:56312
14752024-11-25T19:31:50.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 69ea52da-8fdb-4928-8bc9-f84a92cdd456 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
14762024-11-25T19:31:50.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 69ea52da-8fdb-4928-8bc9-f84a92cdd456 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
14772024-11-25T19:31:50.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 69ea52da-8fdb-4928-8bc9-f84a92cdd456 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
14782024-11-25T19:31:50.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 2e225072-4c90-48e1-b533-e54f6b080b31 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
14792024-11-25T19:31:50.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 2e225072-4c90-48e1-b533-e54f6b080b31 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
14802024-11-25T19:31:50.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 2e225072-4c90-48e1-b533-e54f6b080b31 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
14812024-11-25T19:31:51.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 27c6b0ee-6405-46b8-9083-ad4f5630adf5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14822024-11-25T19:31:51.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 27c6b0ee-6405-46b8-9083-ad4f5630adf5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14832024-11-25T19:31:51.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2609 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 27c6b0ee-6405-46b8-9083-ad4f5630adf5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14842024-11-25T19:31:52.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6058a56e-e07b-49fa-a728-fa53d94fdbaa roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14852024-11-25T19:31:52.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6058a56e-e07b-49fa-a728-fa53d94fdbaa resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14862024-11-25T19:31:52.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6058a56e-e07b-49fa-a728-fa53d94fdbaa response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14872024-11-25T19:31:53.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7150bcff-1321-4efc-ba03-a6111891d594 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14882024-11-25T19:31:53.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7150bcff-1321-4efc-ba03-a6111891d594 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14892024-11-25T19:31:53.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7150bcff-1321-4efc-ba03-a6111891d594 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14902024-11-25T19:31:54.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1ad88568-b5d5-4f26-8218-ba6a1348e02a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14912024-11-25T19:31:54.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1ad88568-b5d5-4f26-8218-ba6a1348e02a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14922024-11-25T19:31:54.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1ad88568-b5d5-4f26-8218-ba6a1348e02a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14932024-11-25T19:31:55.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 10c554d6-2d8d-4b3e-affa-85dd6e285020 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14942024-11-25T19:31:55.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 10c554d6-2d8d-4b3e-affa-85dd6e285020 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14952024-11-25T19:31:55.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 10c554d6-2d8d-4b3e-affa-85dd6e285020 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14962024-11-25T19:31:56.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 691b35c2-8cd7-4aa3-be9c-f2bcff28b690 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14972024-11-25T19:31:56.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 691b35c2-8cd7-4aa3-be9c-f2bcff28b690 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14982024-11-25T19:31:56.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2645 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 691b35c2-8cd7-4aa3-be9c-f2bcff28b690 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
14992024-11-25T19:31:56.846ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
15002024-11-25T19:31:56.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15012024-11-25T19:31:56.846ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
15022024-11-25T19:31:56.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15032024-11-25T19:31:56.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15042024-11-25T19:31:56.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15052024-11-25T19:31:56.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15062024-11-25T19:31:56.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15072024-11-25T19:31:56.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15082024-11-25T19:31:56.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15092024-11-25T19:31:56.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15102024-11-25T19:31:56.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15112024-11-25T19:31:56.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15122024-11-25T19:31:56.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15132024-11-25T19:31:56.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15142024-11-25T19:31:56.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
15152024-11-25T19:31:56.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15162024-11-25T19:31:56.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15172024-11-25T19:31:56.876ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
15182024-11-25T19:31:56.876ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.096891ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
15192024-11-25T19:31:56.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.767982ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15202024-11-25T19:31:57.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4d9e6241-b2f9-490a-9ea6-d21b018e03ae roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15212024-11-25T19:31:57.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4d9e6241-b2f9-490a-9ea6-d21b018e03ae resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15222024-11-25T19:31:57.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4d9e6241-b2f9-490a-9ea6-d21b018e03ae response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15232024-11-25T19:31:58.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 59036013-c348-433b-96b5-cc395a2c9d28 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15242024-11-25T19:31:58.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 59036013-c348-433b-96b5-cc395a2c9d28 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15252024-11-25T19:31:58.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 59036013-c348-433b-96b5-cc395a2c9d28 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15262024-11-25T19:31:59.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f728b4bd-db84-469b-8fcc-e5cebce72c9a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15272024-11-25T19:31:59.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f728b4bd-db84-469b-8fcc-e5cebce72c9a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15282024-11-25T19:31:59.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f728b4bd-db84-469b-8fcc-e5cebce72c9a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15292024-11-25T19:32:00.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 920fd60d-5b0b-41a5-b7de-a78a6d0c918d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15302024-11-25T19:32:00.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 920fd60d-5b0b-41a5-b7de-a78a6d0c918d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15312024-11-25T19:32:00.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 920fd60d-5b0b-41a5-b7de-a78a6d0c918d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15322024-11-25T19:32:01.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 30c72c2e-7222-4792-a1b3-2d0f87fe8f55 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15332024-11-25T19:32:01.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 30c72c2e-7222-4792-a1b3-2d0f87fe8f55 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15342024-11-25T19:32:01.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 30c72c2e-7222-4792-a1b3-2d0f87fe8f55 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15352024-11-25T19:32:02.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a35fca1e-a669-4707-9dbd-badf689788b3 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15362024-11-25T19:32:02.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a35fca1e-a669-4707-9dbd-badf689788b3 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15372024-11-25T19:32:02.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a35fca1e-a669-4707-9dbd-badf689788b3 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15382024-11-25T19:32:03.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = be61e352-31dc-424e-9500-3764a2b1aceb roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15392024-11-25T19:32:03.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = be61e352-31dc-424e-9500-3764a2b1aceb resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15402024-11-25T19:32:03.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = be61e352-31dc-424e-9500-3764a2b1aceb response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15412024-11-25T19:32:04.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9975bf83-021f-4066-81cd-0fed4aed7d32 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15422024-11-25T19:32:04.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9975bf83-021f-4066-81cd-0fed4aed7d32 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15432024-11-25T19:32:04.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9975bf83-021f-4066-81cd-0fed4aed7d32 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15442024-11-25T19:32:05.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 88d63d20-bbf4-487c-9174-d02567d2386c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15452024-11-25T19:32:05.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 88d63d20-bbf4-487c-9174-d02567d2386c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15462024-11-25T19:32:05.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 88d63d20-bbf4-487c-9174-d02567d2386c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15472024-11-25T19:32:06.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 34274369-42f6-4a2f-af3f-21108bf2abb4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15482024-11-25T19:32:06.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 34274369-42f6-4a2f-af3f-21108bf2abb4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15492024-11-25T19:32:06.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 34274369-42f6-4a2f-af3f-21108bf2abb4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15502024-11-25T19:32:06.847ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
15512024-11-25T19:32:06.847ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
15522024-11-25T19:32:06.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15532024-11-25T19:32:06.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15542024-11-25T19:32:06.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15552024-11-25T19:32:06.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15562024-11-25T19:32:06.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15572024-11-25T19:32:06.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15582024-11-25T19:32:06.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15592024-11-25T19:32:06.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15602024-11-25T19:32:06.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15612024-11-25T19:32:06.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15622024-11-25T19:32:06.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15632024-11-25T19:32:06.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15642024-11-25T19:32:06.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15652024-11-25T19:32:06.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
15662024-11-25T19:32:06.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15672024-11-25T19:32:06.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15682024-11-25T19:32:06.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.348712ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15692024-11-25T19:32:06.897ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
15702024-11-25T19:32:06.897ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.037632ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
15712024-11-25T19:32:07.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = d0113514-0bab-4bb8-b91e-7d28215b22f1 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
15722024-11-25T19:32:07.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = d0113514-0bab-4bb8-b91e-7d28215b22f1 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
15732024-11-25T19:32:07.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = d0113514-0bab-4bb8-b91e-7d28215b22f1 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
15742024-11-25T19:32:07.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 97f3eb45-5078-48a7-82eb-b0be80db9fd7 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
15752024-11-25T19:32:07.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 97f3eb45-5078-48a7-82eb-b0be80db9fd7 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
15762024-11-25T19:32:07.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 97f3eb45-5078-48a7-82eb-b0be80db9fd7 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
15772024-11-25T19:32:07.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d14bf5c7-a22d-45cf-a62d-9ec8668e2368 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15782024-11-25T19:32:07.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d14bf5c7-a22d-45cf-a62d-9ec8668e2368 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15792024-11-25T19:32:07.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d14bf5c7-a22d-45cf-a62d-9ec8668e2368 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15802024-11-25T19:32:08.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0b0818b8-b0b7-4bd9-967b-88ea66799819 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15812024-11-25T19:32:08.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0b0818b8-b0b7-4bd9-967b-88ea66799819 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15822024-11-25T19:32:08.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0b0818b8-b0b7-4bd9-967b-88ea66799819 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15832024-11-25T19:32:09.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 505686db-0842-485f-8f5b-c2feab2e45f0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15842024-11-25T19:32:09.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 505686db-0842-485f-8f5b-c2feab2e45f0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15852024-11-25T19:32:09.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 505686db-0842-485f-8f5b-c2feab2e45f0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15862024-11-25T19:32:10.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d270fdbc-e63d-4308-8e2a-0ef6c571c111 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15872024-11-25T19:32:10.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d270fdbc-e63d-4308-8e2a-0ef6c571c111 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15882024-11-25T19:32:10.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d270fdbc-e63d-4308-8e2a-0ef6c571c111 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15892024-11-25T19:32:11.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8fcdc382-5d3a-4263-8d92-7f4d02634872 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15902024-11-25T19:32:11.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8fcdc382-5d3a-4263-8d92-7f4d02634872 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15912024-11-25T19:32:11.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8fcdc382-5d3a-4263-8d92-7f4d02634872 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15922024-11-25T19:32:12.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f4c44e5d-3452-4295-b444-1a5f250c4c52 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15932024-11-25T19:32:12.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f4c44e5d-3452-4295-b444-1a5f250c4c52 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15942024-11-25T19:32:12.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f4c44e5d-3452-4295-b444-1a5f250c4c52 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15952024-11-25T19:32:13.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 53a63d4c-fe4b-4166-a9e1-e5fdf7ea7281 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15962024-11-25T19:32:13.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 53a63d4c-fe4b-4166-a9e1-e5fdf7ea7281 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15972024-11-25T19:32:13.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 53a63d4c-fe4b-4166-a9e1-e5fdf7ea7281 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15982024-11-25T19:32:14.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 36c1c33f-f116-4fc5-99c6-af8bc3f6e0ae roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
15992024-11-25T19:32:14.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 36c1c33f-f116-4fc5-99c6-af8bc3f6e0ae resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
16002024-11-25T19:32:14.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 36c1c33f-f116-4fc5-99c6-af8bc3f6e0ae response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
16012024-11-25T19:32:15.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7121b4c6-7ef0-4af1-9db6-4ca47acbd6e8 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
16022024-11-25T19:32:15.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7121b4c6-7ef0-4af1-9db6-4ca47acbd6e8 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
16032024-11-25T19:32:15.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1751 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7121b4c6-7ef0-4af1-9db6-4ca47acbd6e8 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
16042024-11-25T19:32:16.846ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
16052024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
16062024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16072024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
16082024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16092024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16102024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
16112024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
16122024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16132024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
16142024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
16152024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16162024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16172024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
16182024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
16192024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
16202024-11-25T19:32:16.847ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
16212024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
16222024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
16232024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.36\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
16242024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16252024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16262024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
16272024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
16282024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16292024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
16302024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16312024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
16322024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
16332024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
16342024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16352024-11-25T19:32:16.847ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:22:16.847202195 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
16362024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
16372024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
16382024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
16392024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
16402024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
16412024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16422024-11-25T19:32:16.847ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
16432024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 7.36\u{b5}s iteration = 3 status = {"error":"no config"}
16442024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
16452024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
16462024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16472024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16482024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
16492024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
16502024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16512024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
16522024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
16532024-11-25T19:32:16.847ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
16542024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16552024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
16562024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
16572024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
16582024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
16592024-11-25T19:32:16.847ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16602024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
16612024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16622024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
16632024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
16642024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16652024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
16662024-11-25T19:32:16.847ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
16672024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 10.851\u{b5}s iteration = 3 status = {"error":"no config"}
16682024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
16692024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
16702024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16712024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16722024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16732024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16742024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16752024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
16762024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16772024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16782024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16792024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16802024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16812024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16822024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16832024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16842024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16852024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
16862024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
16872024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16882024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16892024-11-25T19:32:16.847ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1162, tv_nsec: 395462415 } })
16902024-11-25T19:32:16.847ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1162, tv_nsec: 395494616 } })
16912024-11-25T19:32:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
16922024-11-25T19:32:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16932024-11-25T19:32:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16942024-11-25T19:32:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
16952024-11-25T19:32:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
16962024-11-25T19:32:16.848ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
16972024-11-25T19:32:16.848ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.453449ms iteration = 2 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
16982024-11-25T19:32:16.848ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
16992024-11-25T19:32:16.848ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.172493ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
17002024-11-25T19:32:16.849ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17012024-11-25T19:32:16.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17022024-11-25T19:32:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17032024-11-25T19:32:16.851ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1162, tv_nsec: 398847601 } })
17042024-11-25T19:32:16.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17052024-11-25T19:32:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17062024-11-25T19:32:16.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17072024-11-25T19:32:16.851ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
17082024-11-25T19:32:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17092024-11-25T19:32:16.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 008f0807-033a-4aea-9a78-806db741559f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
17102024-11-25T19:32:16.855ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1162, tv_nsec: 402593915 } })
17112024-11-25T19:32:16.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 008f0807-033a-4aea-9a78-806db741559f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
17122024-11-25T19:32:16.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17132024-11-25T19:32:16.855ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
17142024-11-25T19:32:16.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17152024-11-25T19:32:16.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17162024-11-25T19:32:16.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17172024-11-25T19:32:16.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
17182024-11-25T19:32:16.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17192024-11-25T19:32:16.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17202024-11-25T19:32:16.860ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17212024-11-25T19:32:16.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.323111ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
17222024-11-25T19:32:16.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17232024-11-25T19:32:16.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17242024-11-25T19:32:16.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17252024-11-25T19:32:16.863ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:22:16.847202195 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
17262024-11-25T19:32:16.863ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.960434ms iteration = 2 status = {"expiration":"2024-11-25T19:22:16.847202195Z","pruned":[]}
17272024-11-25T19:32:16.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17282024-11-25T19:32:16.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17292024-11-25T19:32:16.866ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 19.084095ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17302024-11-25T19:32:16.866ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.786098ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
17312024-11-25T19:32:16.867ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17322024-11-25T19:32:16.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
17332024-11-25T19:32:16.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17342024-11-25T19:32:16.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17352024-11-25T19:32:16.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17362024-11-25T19:32:16.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17372024-11-25T19:32:16.869ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1162, tv_nsec: 416905656 } })
17382024-11-25T19:32:16.869ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
17392024-11-25T19:32:16.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17402024-11-25T19:32:16.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17412024-11-25T19:32:16.877ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17422024-11-25T19:32:16.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 008f0807-033a-4aea-9a78-806db741559f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
17432024-11-25T19:32:16.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17442024-11-25T19:32:16.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17452024-11-25T19:32:16.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17462024-11-25T19:32:16.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17472024-11-25T19:32:16.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
17482024-11-25T19:32:16.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17492024-11-25T19:32:16.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17502024-11-25T19:32:16.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17512024-11-25T19:32:16.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.827483ms iteration = 3 status = {"errors":[],"records_set_to_done":[]}
17522024-11-25T19:32:16.909ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17532024-11-25T19:32:16.909ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17542024-11-25T19:32:16.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17552024-11-25T19:32:16.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17562024-11-25T19:32:16.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17572024-11-25T19:32:16.909ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17582024-11-25T19:32:16.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.887544ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17592024-11-25T19:32:16.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17602024-11-25T19:32:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
17612024-11-25T19:32:16.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17622024-11-25T19:32:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17632024-11-25T19:32:16.912ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17642024-11-25T19:32:16.912ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
17652024-11-25T19:32:16.912ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
17662024-11-25T19:32:16.912ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 65.302411ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
17672024-11-25T19:32:16.913ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17682024-11-25T19:32:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17692024-11-25T19:32:16.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17702024-11-25T19:32:16.914ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17712024-11-25T19:32:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17722024-11-25T19:32:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17732024-11-25T19:32:16.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17742024-11-25T19:32:16.914ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17752024-11-25T19:32:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17762024-11-25T19:32:16.915ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17772024-11-25T19:32:16.915ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
17782024-11-25T19:32:16.915ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.567355ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
17792024-11-25T19:32:16.917ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17802024-11-25T19:32:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17812024-11-25T19:32:16.917ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17822024-11-25T19:32:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17832024-11-25T19:32:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17842024-11-25T19:32:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
17852024-11-25T19:32:16.917ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17862024-11-25T19:32:16.917ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17872024-11-25T19:32:16.917ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17882024-11-25T19:32:16.917ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17892024-11-25T19:32:16.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17902024-11-25T19:32:16.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17912024-11-25T19:32:16.921ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17922024-11-25T19:32:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17932024-11-25T19:32:16.921ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
17942024-11-25T19:32:16.921ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
17952024-11-25T19:32:16.921ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
17962024-11-25T19:32:16.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17972024-11-25T19:32:16.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17982024-11-25T19:32:16.922ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17992024-11-25T19:32:16.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18002024-11-25T19:32:16.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18012024-11-25T19:32:16.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18022024-11-25T19:32:16.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18032024-11-25T19:32:16.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18042024-11-25T19:32:16.928ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
18052024-11-25T19:32:16.928ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.139832ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
18062024-11-25T19:32:16.930ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
18072024-11-25T19:32:16.930ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18082024-11-25T19:32:16.930ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ca6371b-02d5-4a50-8bec-563c970fe01b", "content-length": "26", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
18092024-11-25T19:32:16.930ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18102024-11-25T19:32:16.933ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18112024-11-25T19:32:16.953ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18122024-11-25T19:32:16.953ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18132024-11-25T19:32:16.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18142024-11-25T19:32:16.954ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
18152024-11-25T19:32:16.954ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18162024-11-25T19:32:16.954ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c355b5c4-cdd8-498e-bb69-e236b7888204", "content-length": "26", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
18172024-11-25T19:32:16.954ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18182024-11-25T19:32:16.955ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
18192024-11-25T19:32:16.955ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
18202024-11-25T19:32:16.955ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
18212024-11-25T19:32:16.955ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18222024-11-25T19:32:16.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18232024-11-25T19:32:16.956ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18242024-11-25T19:32:16.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18252024-11-25T19:32:16.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18262024-11-25T19:32:16.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18272024-11-25T19:32:16.956ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18282024-11-25T19:32:16.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18292024-11-25T19:32:16.959ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18302024-11-25T19:32:16.960ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 113.550157ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
18312024-11-25T19:32:16.961ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 113.779192ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
18322024-11-25T19:32:16.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
18332024-11-25T19:32:16.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18342024-11-25T19:32:16.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18352024-11-25T19:32:16.964ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18362024-11-25T19:32:16.965ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
18372024-11-25T19:32:16.965ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18382024-11-25T19:32:16.965ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 118.527616ms iteration = 3 status = 0
18392024-11-25T19:32:16.965ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "49cb6fcd-e4a3-446b-b796-fd80e405aa79", "content-length": "26", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
18402024-11-25T19:32:16.965ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18412024-11-25T19:32:16.967ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
18422024-11-25T19:32:16.967ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
18432024-11-25T19:32:16.967ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 119.771199ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
18442024-11-25T19:32:16.967ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
18452024-11-25T19:32:16.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
18462024-11-25T19:32:16.967ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18472024-11-25T19:32:16.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18482024-11-25T19:32:16.968ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18492024-11-25T19:32:16.968ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18502024-11-25T19:32:16.968ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18512024-11-25T19:32:16.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18522024-11-25T19:32:16.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 125.935501ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
18532024-11-25T19:32:16.976ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
18542024-11-25T19:32:16.976ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
18552024-11-25T19:32:16.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18562024-11-25T19:32:16.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18572024-11-25T19:32:16.990ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
18582024-11-25T19:32:16.990ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 143.515005ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
18592024-11-25T19:32:16.995ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18602024-11-25T19:32:16.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18612024-11-25T19:32:16.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18622024-11-25T19:32:16.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18632024-11-25T19:32:16.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad1c35b6-2a67-4e92-aaf1-4b9b5d9f0b1d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
18642024-11-25T19:32:16.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad1c35b6-2a67-4e92-aaf1-4b9b5d9f0b1d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
18652024-11-25T19:32:17.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad1c35b6-2a67-4e92-aaf1-4b9b5d9f0b1d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
18662024-11-25T19:32:17.008ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18672024-11-25T19:32:17.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18682024-11-25T19:32:17.009ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 162.747223ms iteration = 5 status = {"physical_disks_added":0}
18692024-11-25T19:32:17.010ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18702024-11-25T19:32:17.012ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18712024-11-25T19:32:17.012ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
18722024-11-25T19:32:17.012ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 165.308693ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
18732024-11-25T19:32:17.012ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18742024-11-25T19:32:17.012ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18752024-11-25T19:32:17.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18762024-11-25T19:32:17.015ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18772024-11-25T19:32:17.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18782024-11-25T19:32:17.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18792024-11-25T19:32:17.021ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18802024-11-25T19:32:17.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18812024-11-25T19:32:17.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18822024-11-25T19:32:17.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18832024-11-25T19:32:17.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18842024-11-25T19:32:17.023ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18852024-11-25T19:32:17.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18862024-11-25T19:32:17.024ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18872024-11-25T19:32:17.026ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 179.368509ms iteration = 3 status = {}
18882024-11-25T19:32:17.026ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18892024-11-25T19:32:17.026ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18902024-11-25T19:32:17.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18912024-11-25T19:32:17.029ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
18922024-11-25T19:32:17.029ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
18932024-11-25T19:32:17.029ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
18942024-11-25T19:32:17.029ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 182.126123ms iteration = 2 status = {"generation":1}
18952024-11-25T19:32:17.029ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
18962024-11-25T19:32:17.041ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
18972024-11-25T19:32:17.041ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
18982024-11-25T19:32:17.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18992024-11-25T19:32:17.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19002024-11-25T19:32:17.043ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19012024-11-25T19:32:17.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19022024-11-25T19:32:17.046ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19032024-11-25T19:32:17.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19042024-11-25T19:32:17.053ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19052024-11-25T19:32:17.054ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6bfa095-e898-4a44-9830-1197c34f53d0", "content-length": "1", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
19062024-11-25T19:32:17.056ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19072024-11-25T19:32:17.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19082024-11-25T19:32:17.063ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
19092024-11-25T19:32:17.063ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
19102024-11-25T19:32:17.063ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
19112024-11-25T19:32:17.063ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 215.901456ms iteration = 2 status = {"generation":2}
19122024-11-25T19:32:17.063ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
19132024-11-25T19:32:17.081ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
19142024-11-25T19:32:17.081ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 234.537032ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
19152024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = / versions = all
19162024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access versions = all
19172024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path} versions = all
19182024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth versions = all
19192024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm versions = all
19202024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success versions = all
19212024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token versions = all
19222024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify versions = all
19232024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes versions = all
19242024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes versions = all
19252024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
19262024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe} versions = all
19272024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images versions = all
19282024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login versions = all
19292024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local versions = all
19302024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
19312024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
19322024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
19332024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path} versions = all
19342024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path} versions = all
19352024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new versions = all
19362024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path} versions = all
19372024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path} versions = all
19382024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization versions = all
19392024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates versions = all
19402024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates versions = all
19412024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate} versions = all
19422024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate} versions = all
19432024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks versions = all
19442024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks versions = all
19452024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk} versions = all
19462024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk} versions = all
19472024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
19482024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
19492024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
19502024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize versions = all
19512024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
19522024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips versions = all
19532024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips versions = all
19542024-11-25T19:32:17.117ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
19552024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
19562024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
19572024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
19582024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
19592024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups versions = all
19602024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id} versions = all
19612024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images versions = all
19622024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images versions = all
19632024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image} versions = all
19642024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image} versions = all
19652024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote versions = all
19662024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote versions = all
19672024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances versions = all
19682024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances versions = all
19692024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance} versions = all
19702024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance} versions = all
19712024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/instances/{instance} versions = all
19722024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks versions = all
19732024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
19742024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
19752024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
19762024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
19772024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
19782024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot versions = all
19792024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
19802024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
19812024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
19822024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start versions = all
19832024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop versions = all
19842024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
19852024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
19862024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
19872024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
19882024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
19892024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
19902024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways versions = all
19912024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateways versions = all
19922024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
19932024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
19942024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools versions = all
19952024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool} versions = all
19962024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local versions = all
19972024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout versions = all
19982024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me versions = all
19992024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups versions = all
20002024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys versions = all
20012024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys versions = all
20022024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
20032024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
20042024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name} versions = all
20052024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces versions = all
20062024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces versions = all
20072024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
20082024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface} versions = all
20092024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
20102024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping versions = all
20112024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy versions = all
20122024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy versions = all
20132024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects versions = all
20142024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects versions = all
20152024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project} versions = all
20162024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project} versions = all
20172024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project} versions = all
20182024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy versions = all
20192024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy versions = all
20202024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots versions = all
20212024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots versions = all
20222024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
20232024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot} versions = all
20242024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks versions = all
20252024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
20262024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks versions = all
20272024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
20282024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds versions = all
20292024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds versions = all
20302024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
20312024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
20322024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
20332024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
20342024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
20352024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port versions = all
20362024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
20372024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
20382024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
20392024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches versions = all
20402024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
20412024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers versions = all
20422024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users versions = all
20432024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
20442024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
20452024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml versions = all
20462024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
20472024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools versions = all
20482024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools versions = all
20492024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
20502024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
20512024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
20522024-11-25T19:32:17.118ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
20532024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
20542024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
20552024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
20562024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
20572024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
20582024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
20592024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
20602024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service versions = all
20612024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
20622024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
20632024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
20642024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
20652024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot versions = all
20662024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot versions = all
20672024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
20682024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
20692024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list versions = all
20702024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list versions = all
20712024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable versions = all
20722024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable versions = all
20732024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status versions = all
20742024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp versions = all
20752024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp versions = all
20762024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp versions = all
20772024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
20782024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
20792024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
20802024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
20812024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported versions = all
20822024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
20832024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
20842024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status versions = all
20852024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address versions = all
20862024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address versions = all
20872024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
20882024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
20892024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
20902024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
20912024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
20922024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy versions = all
20932024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy versions = all
20942024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles versions = all
20952024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name} versions = all
20962024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas versions = all
20972024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos versions = all
20982024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos versions = all
20992024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo} versions = all
21002024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo} versions = all
21012024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
21022024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
21032024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
21042024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
21052024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
21062024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/timeseries/query versions = all
21072024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/timeseries/schemas versions = all
21082024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository versions = all
21092024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
21102024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users versions = all
21112024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id} versions = all
21122024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin versions = all
21132024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user} versions = all
21142024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos versions = all
21152024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
21162024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users versions = all
21172024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization versions = all
21182024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules versions = all
21192024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules versions = all
21202024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes versions = all
21212024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes versions = all
21222024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
21232024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
21242024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
21252024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers versions = all
21262024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers versions = all
21272024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
21282024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router} versions = all
21292024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router} versions = all
21302024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets versions = all
21312024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets versions = all
21322024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
21332024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
21342024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
21352024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
21362024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs versions = all
21372024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs versions = all
21382024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
21392024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc} versions = all
21402024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc} versions = all
21412024-11-25T19:32:17.119ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = 172.30.2.7:443
21422024-11-25T19:32:17.119ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
21432024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = / versions = all
21442024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access versions = all
21452024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path} versions = all
21462024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth versions = all
21472024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm versions = all
21482024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success versions = all
21492024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token versions = all
21502024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify versions = all
21512024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes versions = all
21522024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes versions = all
21532024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
21542024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
21552024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images versions = all
21562024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login versions = all
21572024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local versions = all
21582024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
21592024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
21602024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
21612024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path} versions = all
21622024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path} versions = all
21632024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new versions = all
21642024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path} versions = all
21652024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path} versions = all
21662024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization versions = all
21672024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates versions = all
21682024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates versions = all
21692024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
21702024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate} versions = all
21712024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks versions = all
21722024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks versions = all
21732024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk} versions = all
21742024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk} versions = all
21752024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
21762024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
21772024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
21782024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
21792024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
21802024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips versions = all
21812024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips versions = all
21822024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
21832024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
21842024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
21852024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
21862024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
21872024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups versions = all
21882024-11-25T19:32:17.127ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id} versions = all
21892024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images versions = all
21902024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images versions = all
21912024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image} versions = all
21922024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image} versions = all
21932024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote versions = all
21942024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote versions = all
21952024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances versions = all
21962024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances versions = all
21972024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance} versions = all
21982024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance} versions = all
21992024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/instances/{instance} versions = all
22002024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
22012024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
22022024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
22032024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
22042024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
22052024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
22062024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
22072024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
22082024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
22092024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
22102024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start versions = all
22112024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
22122024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
22132024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
22142024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
22152024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
22162024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
22172024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
22182024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways versions = all
22192024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateways versions = all
22202024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
22212024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
22222024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools versions = all
22232024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
22242024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
22252024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout versions = all
22262024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me versions = all
22272024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups versions = all
22282024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys versions = all
22292024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys versions = all
22302024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
22312024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
22322024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
22332024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces versions = all
22342024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces versions = all
22352024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
22362024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
22372024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
22382024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping versions = all
22392024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy versions = all
22402024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy versions = all
22412024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects versions = all
22422024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects versions = all
22432024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project} versions = all
22442024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project} versions = all
22452024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project} versions = all
22462024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy versions = all
22472024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
22482024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots versions = all
22492024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots versions = all
22502024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
22512024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
22522024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks versions = all
22532024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
22542024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks versions = all
22552024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
22562024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds versions = all
22572024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds versions = all
22582024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
22592024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
22602024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
22612024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
22622024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
22632024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
22642024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
22652024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
22662024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
22672024-11-25T19:32:17.128ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches versions = all
22682024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
22692024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers versions = all
22702024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
22712024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
22722024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
22732024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
22742024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
22752024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools versions = all
22762024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools versions = all
22772024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
22782024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
22792024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
22802024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
22812024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
22822024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
22832024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
22842024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
22852024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
22862024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
22872024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
22882024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service versions = all
22892024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
22902024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
22912024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
22922024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
22932024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot versions = all
22942024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot versions = all
22952024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
22962024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
22972024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list versions = all
22982024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
22992024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
23002024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
23012024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
23022024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
23032024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp versions = all
23042024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp versions = all
23052024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
23062024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
23072024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
23082024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
23092024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
23102024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
23112024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
23122024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
23132024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
23142024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
23152024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
23162024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
23172024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
23182024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
23192024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
23202024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy versions = all
23212024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy versions = all
23222024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles versions = all
23232024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
23242024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas versions = all
23252024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos versions = all
23262024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos versions = all
23272024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
23282024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo} versions = all
23292024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
23302024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
23312024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
23322024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
23332024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
23342024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/timeseries/query versions = all
23352024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
23362024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository versions = all
23372024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
23382024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users versions = all
23392024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id} versions = all
23402024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin versions = all
23412024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
23422024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos versions = all
23432024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
23442024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users versions = all
23452024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization versions = all
23462024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
23472024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
23482024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes versions = all
23492024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes versions = all
23502024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
23512024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
23522024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
23532024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers versions = all
23542024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers versions = all
23552024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
23562024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
23572024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
23582024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets versions = all
23592024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets versions = all
23602024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
23612024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
23622024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
23632024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
23642024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs versions = all
23652024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs versions = all
23662024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
23672024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
23682024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
23692024-11-25T19:32:17.129ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12228
23702024-11-25T19:32:17.129ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
23712024-11-25T19:32:17.130ZDEBGnexus (nexus-producer-server): registered DTrace probes
23722024-11-25T19:32:17.136ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:46244 method = GET path = /{producer_id} versions = all
23732024-11-25T19:32:17.137ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:46244
23742024-11-25T19:32:17.137ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:46244
23752024-11-25T19:32:17.137ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:46244
23762024-11-25T19:32:17.137ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
23772024-11-25T19:32:17.137ZDEBGnexus (nexus-producer-server): starting producer registration task
23782024-11-25T19:32:17.138ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:46244 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
23792024-11-25T19:32:17.138ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
23802024-11-25T19:32:17.138ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
23812024-11-25T19:32:17.186ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23822024-11-25T19:32:17.186ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "752076cc-1801-4d10-868c-91b065dae4a2", "content-length": "691", "date": "Mon, 25 Nov 2024 19:32:17 GMT"} })
23832024-11-25T19:32:17.186ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
23842024-11-25T19:32:17.186ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
23852024-11-25T19:32:17.186ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
23862024-11-25T19:32:17.187ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
23872024-11-25T19:32:17.187ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23882024-11-25T19:32:17.187ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc46c4de-9121-4df8-8663-e3a7309fb0a1", "content-length": "372", "date": "Mon, 25 Nov 2024 19:32:17 GMT"} })
23892024-11-25T19:32:17.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23902024-11-25T19:32:17.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23912024-11-25T19:32:17.188ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 341.582622ms iteration = 3 status = {}
23922024-11-25T19:32:17.190ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 343.368737ms iteration = 3 status = null
23932024-11-25T19:32:17.193ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
23942024-11-25T19:32:17.202ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
23952024-11-25T19:32:17.202ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
23962024-11-25T19:32:17.203ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "905ba153-b226-4e19-a122-8b8746756c14", "date": "Mon, 25 Nov 2024 19:32:17 GMT"} })
23972024-11-25T19:32:17.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23982024-11-25T19:32:17.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23992024-11-25T19:32:17.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24002024-11-25T19:32:17.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24012024-11-25T19:32:17.209ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24022024-11-25T19:32:17.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24032024-11-25T19:32:17.213ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
24042024-11-25T19:32:17.213ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24052024-11-25T19:32:17.214ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4be56290-7f02-49f0-844a-1cfcf46845b1", "date": "Mon, 25 Nov 2024 19:32:17 GMT"} })
24062024-11-25T19:32:17.215ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 368.391958ms iteration = 3 status = {}
24072024-11-25T19:32:17.223ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
24082024-11-25T19:32:17.275ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
24092024-11-25T19:32:17.275ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:48622
24102024-11-25T19:32:17.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:48622 req_id = 670ab147-b545-4abd-91f8-6d2855871a68 roles = RoleSet { roles: {} } uri = /metrics/producers
24112024-11-25T19:32:17.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:48622 req_id = 670ab147-b545-4abd-91f8-6d2855871a68 resource = Database result = Ok(()) uri = /metrics/producers
24122024-11-25T19:32:17.294ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
24132024-11-25T19:32:17.316ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24142024-11-25T19:32:17.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24152024-11-25T19:32:17.318ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
24162024-11-25T19:32:17.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24172024-11-25T19:32:17.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24182024-11-25T19:32:17.320ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
24192024-11-25T19:32:17.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45422 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:48622 req_id = 670ab147-b545-4abd-91f8-6d2855871a68 response_code = 201 uri = /metrics/producers
24202024-11-25T19:32:17.321ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "670ab147-b545-4abd-91f8-6d2855871a68", "content-length": "41", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
24212024-11-25T19:32:17.323ZDEBGnexus (producer-registration-task): registered with nexus successfully
24222024-11-25T19:32:17.323ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
24232024-11-25T19:32:17.326ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
24242024-11-25T19:32:17.326ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4337d201-693f-4753-af46-b1959ec6ee08", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24252024-11-25T19:32:17.326ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24262024-11-25T19:32:17.327ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f3e4035a-a758-41b3-af7c-548f4176a90e", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24272024-11-25T19:32:17.327ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24282024-11-25T19:32:17.329ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24292024-11-25T19:32:17.329ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 266.211033ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
24302024-11-25T19:32:17.329ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24312024-11-25T19:32:17.330ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b20afb3b-9345-49af-bf71-2a391945ba37", "content-length": "134", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
24322024-11-25T19:32:17.330ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
24332024-11-25T19:32:17.330ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
24342024-11-25T19:32:17.330ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24352024-11-25T19:32:17.330ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24362024-11-25T19:32:17.330ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24372024-11-25T19:32:17.330ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24382024-11-25T19:32:17.330ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24392024-11-25T19:32:17.330ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24402024-11-25T19:32:17.330ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24412024-11-25T19:32:17.330ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24422024-11-25T19:32:17.330ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
24432024-11-25T19:32:17.330ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24442024-11-25T19:32:17.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24452024-11-25T19:32:17.333ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24462024-11-25T19:32:17.333ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "719d7d40-a3e7-4201-a499-a91a58f11efe", "content-length": "2", "date": "Mon, 25 Nov 2024 19:32:17 GMT"} })
24472024-11-25T19:32:17.333ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24482024-11-25T19:32:17.333ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3e6bf48-727a-4cdd-bbdd-097d8576a481", "content-length": "51", "date": "Mon, 25 Nov 2024 19:32:17 GMT"} })
24492024-11-25T19:32:17.333ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
24502024-11-25T19:32:17.333ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24512024-11-25T19:32:17.344ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24522024-11-25T19:32:17.344ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "169815e9-5cc2-46ea-b11f-7da34326fe96", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24532024-11-25T19:32:17.345ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24542024-11-25T19:32:17.346ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "214a9503-5556-4f36-a89c-b42068a03564", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24552024-11-25T19:32:17.346ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24562024-11-25T19:32:17.347ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "20f01c16-b7b8-4ab8-a70d-ca748f7c034e", "date": "Mon, 25 Nov 2024 19:32:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24572024-11-25T19:32:17.347ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24582024-11-25T19:32:17.349ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24592024-11-25T19:32:17.349ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 319.580231ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
24602024-11-25T19:32:17.427ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7f2bf0a7-f6a9-4f00-8e9d-2113ca30c24d", "date": "Mon, 25 Nov 2024 19:32:17 GMT"} })
24612024-11-25T19:32:17.427ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
24622024-11-25T19:32:17.427ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24632024-11-25T19:32:17.427ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1050bea7-71b1-494a-b7e9-f75e6b5b9054", "content-length": "682", "date": "Mon, 25 Nov 2024 19:32:17 GMT"} })
24642024-11-25T19:32:17.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24652024-11-25T19:32:17.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24662024-11-25T19:32:17.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24672024-11-25T19:32:17.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24682024-11-25T19:32:17.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24692024-11-25T19:32:17.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24702024-11-25T19:32:17.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24712024-11-25T19:32:17.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24722024-11-25T19:32:17.457ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 610.439057ms iteration = 3 status = {}
24732024-11-25T19:32:18.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4ef00e0-9562-4e05-9961-d30ac44400c5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24742024-11-25T19:32:18.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4ef00e0-9562-4e05-9961-d30ac44400c5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24752024-11-25T19:32:18.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4ef00e0-9562-4e05-9961-d30ac44400c5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24762024-11-25T19:32:19.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5bf30ea-2761-4083-97ef-a309c34a482e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24772024-11-25T19:32:19.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5bf30ea-2761-4083-97ef-a309c34a482e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24782024-11-25T19:32:19.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5bf30ea-2761-4083-97ef-a309c34a482e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24792024-11-25T19:32:20.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0ebb1d4e-e202-408a-93e1-1b6fd7ebff2e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24802024-11-25T19:32:20.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0ebb1d4e-e202-408a-93e1-1b6fd7ebff2e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24812024-11-25T19:32:20.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0ebb1d4e-e202-408a-93e1-1b6fd7ebff2e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24822024-11-25T19:32:21.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1f40c0d9-34ea-4da3-a63b-7321a1278438 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24832024-11-25T19:32:21.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1f40c0d9-34ea-4da3-a63b-7321a1278438 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24842024-11-25T19:32:21.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2748 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1f40c0d9-34ea-4da3-a63b-7321a1278438 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24852024-11-25T19:32:22.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b90783b6-2d96-4c49-8e5a-cbbdc7e95802 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24862024-11-25T19:32:22.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b90783b6-2d96-4c49-8e5a-cbbdc7e95802 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24872024-11-25T19:32:22.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b90783b6-2d96-4c49-8e5a-cbbdc7e95802 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24882024-11-25T19:32:22.437ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:46244 remote_addr = [fd00:1122:3344:101::d]:63859
24892024-11-25T19:32:22.441ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3162 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 11c85c80-34fe-45a5-9942-ca4425233722 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
24902024-11-25T19:32:23.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5d79527e-a7ce-4669-a0db-c0dcbf9c741d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24912024-11-25T19:32:23.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5d79527e-a7ce-4669-a0db-c0dcbf9c741d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24922024-11-25T19:32:23.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5d79527e-a7ce-4669-a0db-c0dcbf9c741d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24932024-11-25T19:32:24.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 31ae5de4-3538-4102-92c2-14879719ba89 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24942024-11-25T19:32:24.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 31ae5de4-3538-4102-92c2-14879719ba89 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24952024-11-25T19:32:24.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2768 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 31ae5de4-3538-4102-92c2-14879719ba89 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24962024-11-25T19:32:25.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 070c46fd-506d-49a6-8630-765dc5e7a747 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24972024-11-25T19:32:25.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 070c46fd-506d-49a6-8630-765dc5e7a747 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24982024-11-25T19:32:25.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 070c46fd-506d-49a6-8630-765dc5e7a747 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
24992024-11-25T19:32:26.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5eeaec41-71fb-427a-a064-504a3267fe4b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25002024-11-25T19:32:26.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5eeaec41-71fb-427a-a064-504a3267fe4b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25012024-11-25T19:32:26.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5eeaec41-71fb-427a-a064-504a3267fe4b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25022024-11-25T19:32:26.847ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
25032024-11-25T19:32:26.847ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
25042024-11-25T19:32:26.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25052024-11-25T19:32:26.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25062024-11-25T19:32:26.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25072024-11-25T19:32:26.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25082024-11-25T19:32:26.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25092024-11-25T19:32:26.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25102024-11-25T19:32:26.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25112024-11-25T19:32:26.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25122024-11-25T19:32:26.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25132024-11-25T19:32:26.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25142024-11-25T19:32:26.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25152024-11-25T19:32:26.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
25162024-11-25T19:32:26.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25172024-11-25T19:32:26.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25182024-11-25T19:32:26.867ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
25192024-11-25T19:32:26.867ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.325538ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
25202024-11-25T19:32:26.876ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25212024-11-25T19:32:26.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25222024-11-25T19:32:26.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.937365ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25232024-11-25T19:32:27.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4baa7d65-6df7-48c0-bf0c-116d11e8dedf roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25242024-11-25T19:32:27.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4baa7d65-6df7-48c0-bf0c-116d11e8dedf resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25252024-11-25T19:32:27.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4baa7d65-6df7-48c0-bf0c-116d11e8dedf response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25262024-11-25T19:32:28.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a1ed5fa8-bac2-41ee-8290-6f4f812f8495 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25272024-11-25T19:32:28.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a1ed5fa8-bac2-41ee-8290-6f4f812f8495 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25282024-11-25T19:32:28.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a1ed5fa8-bac2-41ee-8290-6f4f812f8495 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25292024-11-25T19:32:29.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ab7a2c87-54a5-4837-9b24-ad5039592a47 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25302024-11-25T19:32:29.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ab7a2c87-54a5-4837-9b24-ad5039592a47 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25312024-11-25T19:32:29.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ab7a2c87-54a5-4837-9b24-ad5039592a47 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25322024-11-25T19:32:30.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 94d36068-1cbf-456b-a8a9-d821c2eee80e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25332024-11-25T19:32:30.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 94d36068-1cbf-456b-a8a9-d821c2eee80e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25342024-11-25T19:32:30.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 94d36068-1cbf-456b-a8a9-d821c2eee80e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25352024-11-25T19:32:31.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ea57b9d9-4399-4e3e-90d6-0108ab1582b3 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25362024-11-25T19:32:31.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ea57b9d9-4399-4e3e-90d6-0108ab1582b3 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25372024-11-25T19:32:31.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ea57b9d9-4399-4e3e-90d6-0108ab1582b3 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25382024-11-25T19:32:32.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 582 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = bed5cd28-bce9-4587-83e8-cf54d1a29522 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
25392024-11-25T19:32:32.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5c19c241-b394-4407-a441-02e9a2c22584 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25402024-11-25T19:32:32.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5c19c241-b394-4407-a441-02e9a2c22584 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25412024-11-25T19:32:32.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5c19c241-b394-4407-a441-02e9a2c22584 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25422024-11-25T19:32:33.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b0b3a4fa-5427-4505-b7da-2c019ba4ca7f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25432024-11-25T19:32:33.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b0b3a4fa-5427-4505-b7da-2c019ba4ca7f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25442024-11-25T19:32:33.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b0b3a4fa-5427-4505-b7da-2c019ba4ca7f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25452024-11-25T19:32:34.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dae2cb8f-9e41-4aa2-992d-e8636c042fc0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25462024-11-25T19:32:34.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dae2cb8f-9e41-4aa2-992d-e8636c042fc0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25472024-11-25T19:32:34.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dae2cb8f-9e41-4aa2-992d-e8636c042fc0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25482024-11-25T19:32:35.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 51154923-e636-41bb-b6b4-9a6bb2a79954 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25492024-11-25T19:32:35.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 51154923-e636-41bb-b6b4-9a6bb2a79954 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25502024-11-25T19:32:35.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 51154923-e636-41bb-b6b4-9a6bb2a79954 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25512024-11-25T19:32:36.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 339c0bb8-589f-4e5a-bec5-d594319ef7fd roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25522024-11-25T19:32:36.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 339c0bb8-589f-4e5a-bec5-d594319ef7fd resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25532024-11-25T19:32:36.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 339c0bb8-589f-4e5a-bec5-d594319ef7fd response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25542024-11-25T19:32:36.847ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
25552024-11-25T19:32:36.847ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
25562024-11-25T19:32:36.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25572024-11-25T19:32:36.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25582024-11-25T19:32:36.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25592024-11-25T19:32:36.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25602024-11-25T19:32:36.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25612024-11-25T19:32:36.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25622024-11-25T19:32:36.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25632024-11-25T19:32:36.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25642024-11-25T19:32:36.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25652024-11-25T19:32:36.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25662024-11-25T19:32:36.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25672024-11-25T19:32:36.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
25682024-11-25T19:32:36.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25692024-11-25T19:32:36.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25702024-11-25T19:32:36.868ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
25712024-11-25T19:32:36.868ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.696556ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
25722024-11-25T19:32:36.875ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25732024-11-25T19:32:36.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25742024-11-25T19:32:36.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.084848ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25752024-11-25T19:32:37.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 0c499fed-8104-401c-9306-70faa08aa60d roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
25762024-11-25T19:32:37.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 0c499fed-8104-401c-9306-70faa08aa60d resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
25772024-11-25T19:32:37.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 0c499fed-8104-401c-9306-70faa08aa60d response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
25782024-11-25T19:32:37.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = a040645f-8aa1-4a21-b53c-015e6a5d6105 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
25792024-11-25T19:32:37.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = a040645f-8aa1-4a21-b53c-015e6a5d6105 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
25802024-11-25T19:32:37.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = a040645f-8aa1-4a21-b53c-015e6a5d6105 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
25812024-11-25T19:32:37.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8a66a31b-2af4-4626-bfe4-9321fd62caa0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25822024-11-25T19:32:37.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8a66a31b-2af4-4626-bfe4-9321fd62caa0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25832024-11-25T19:32:37.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8a66a31b-2af4-4626-bfe4-9321fd62caa0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25842024-11-25T19:32:38.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 43b91ab9-f9d5-441d-b346-2dc08c299890 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25852024-11-25T19:32:38.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 43b91ab9-f9d5-441d-b346-2dc08c299890 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25862024-11-25T19:32:38.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 43b91ab9-f9d5-441d-b346-2dc08c299890 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25872024-11-25T19:32:39.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cbb016c1-3efb-4fb0-95cb-8cca559b49ca roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25882024-11-25T19:32:39.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cbb016c1-3efb-4fb0-95cb-8cca559b49ca resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25892024-11-25T19:32:39.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cbb016c1-3efb-4fb0-95cb-8cca559b49ca response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25902024-11-25T19:32:40.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f83aa04c-59dd-45e1-99e2-6c41849e5ebf roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25912024-11-25T19:32:40.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f83aa04c-59dd-45e1-99e2-6c41849e5ebf resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25922024-11-25T19:32:40.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f83aa04c-59dd-45e1-99e2-6c41849e5ebf response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25932024-11-25T19:32:41.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 86e59fb8-5df0-4c44-8652-e3ff0f6f1638 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25942024-11-25T19:32:41.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 86e59fb8-5df0-4c44-8652-e3ff0f6f1638 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25952024-11-25T19:32:41.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 86e59fb8-5df0-4c44-8652-e3ff0f6f1638 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25962024-11-25T19:32:42.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 588 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 5b681657-b2ad-4cac-a8c3-b0fe4c51fa91 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
25972024-11-25T19:32:42.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 012832b9-e5cb-42f8-8f1a-cf1d93af0267 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25982024-11-25T19:32:42.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 012832b9-e5cb-42f8-8f1a-cf1d93af0267 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
25992024-11-25T19:32:42.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 012832b9-e5cb-42f8-8f1a-cf1d93af0267 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
26002024-11-25T19:32:43.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ea2ffb2c-6258-4e7b-a481-bef2492879dd roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
26012024-11-25T19:32:43.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ea2ffb2c-6258-4e7b-a481-bef2492879dd resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
26022024-11-25T19:32:43.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ea2ffb2c-6258-4e7b-a481-bef2492879dd response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
26032024-11-25T19:32:44.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 08b799cd-0f50-40bb-8541-4de65af2ba85 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
26042024-11-25T19:32:44.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 08b799cd-0f50-40bb-8541-4de65af2ba85 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
26052024-11-25T19:32:44.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 08b799cd-0f50-40bb-8541-4de65af2ba85 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
26062024-11-25T19:32:45.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4ce68278-d6c8-4515-a686-f28e01db158f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
26072024-11-25T19:32:45.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4ce68278-d6c8-4515-a686-f28e01db158f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
26082024-11-25T19:32:45.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4ce68278-d6c8-4515-a686-f28e01db158f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
26092024-11-25T19:32:46.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a23a854e-36df-4fa4-b23b-18dad1be66ee roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
26102024-11-25T19:32:46.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a23a854e-36df-4fa4-b23b-18dad1be66ee resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
26112024-11-25T19:32:46.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a23a854e-36df-4fa4-b23b-18dad1be66ee response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
26122024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
26132024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
26142024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26152024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26162024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
26172024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26182024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26192024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
26202024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
26212024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26222024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26232024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
26242024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26252024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
26262024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
26272024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26282024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
26292024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26302024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
26312024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
26322024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
26332024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
26342024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26352024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
26362024-11-25T19:32:46.847ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
26372024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26382024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26392024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
26402024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
26412024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
26422024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26432024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
26442024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
26452024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26462024-11-25T19:32:46.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26472024-11-25T19:32:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26482024-11-25T19:32:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26492024-11-25T19:32:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26502024-11-25T19:32:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26512024-11-25T19:32:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26522024-11-25T19:32:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26532024-11-25T19:32:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26542024-11-25T19:32:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
26552024-11-25T19:32:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26562024-11-25T19:32:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26572024-11-25T19:32:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26582024-11-25T19:32:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26592024-11-25T19:32:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26602024-11-25T19:32:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
26612024-11-25T19:32:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26622024-11-25T19:32:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26632024-11-25T19:32:46.851ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.483008ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26642024-11-25T19:32:46.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26652024-11-25T19:32:46.851ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1192, tv_nsec: 398937373 } })
26662024-11-25T19:32:46.852ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
26672024-11-25T19:32:46.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26682024-11-25T19:32:46.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26692024-11-25T19:32:46.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26702024-11-25T19:32:46.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26712024-11-25T19:32:46.857ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26722024-11-25T19:32:46.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.15034ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
26732024-11-25T19:32:46.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26742024-11-25T19:32:46.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26752024-11-25T19:32:46.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26762024-11-25T19:32:46.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
26772024-11-25T19:32:46.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26782024-11-25T19:32:46.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26792024-11-25T19:32:46.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26802024-11-25T19:32:46.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26812024-11-25T19:32:46.863ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1192, tv_nsec: 410265955 } })
26822024-11-25T19:32:46.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26832024-11-25T19:32:46.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26842024-11-25T19:32:46.863ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
26852024-11-25T19:32:46.875ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1192, tv_nsec: 422795672 } })
26862024-11-25T19:32:46.875ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
26872024-11-25T19:32:46.884ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26882024-11-25T19:32:46.884ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
26892024-11-25T19:32:46.884ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26902024-11-25T19:32:46.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26912024-11-25T19:32:46.886ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26922024-11-25T19:32:46.886ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26932024-11-25T19:32:46.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26942024-11-25T19:32:46.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26952024-11-25T19:32:46.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 39.081926ms iteration = 4 status = {"errors":[],"records_set_to_done":[]}
26962024-11-25T19:32:46.888ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26972024-11-25T19:32:46.888ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
26982024-11-25T19:32:46.888ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26992024-11-25T19:32:46.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27002024-11-25T19:32:46.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27012024-11-25T19:32:46.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27022024-11-25T19:32:46.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27032024-11-25T19:32:46.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27042024-11-25T19:32:46.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27052024-11-25T19:32:46.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27062024-11-25T19:32:46.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27072024-11-25T19:32:46.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27082024-11-25T19:32:46.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27092024-11-25T19:32:46.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 52.314997ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27102024-11-25T19:32:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27112024-11-25T19:32:46.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27122024-11-25T19:32:46.902ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27132024-11-25T19:32:46.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27142024-11-25T19:32:46.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27152024-11-25T19:32:46.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27162024-11-25T19:32:46.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27172024-11-25T19:32:46.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27182024-11-25T19:32:46.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
27192024-11-25T19:32:46.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27202024-11-25T19:32:46.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27212024-11-25T19:32:46.904ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27222024-11-25T19:32:46.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27232024-11-25T19:32:46.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27242024-11-25T19:32:46.905ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27252024-11-25T19:32:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27262024-11-25T19:32:46.906ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27272024-11-25T19:32:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27282024-11-25T19:32:46.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27292024-11-25T19:32:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27302024-11-25T19:32:46.907ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27312024-11-25T19:32:46.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27322024-11-25T19:32:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27332024-11-25T19:32:46.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 5e003d63-2bcc-47e6-918f-2aa3a7f45d69 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
27342024-11-25T19:32:46.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
27352024-11-25T19:32:46.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27362024-11-25T19:32:46.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 5e003d63-2bcc-47e6-918f-2aa3a7f45d69 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
27372024-11-25T19:32:46.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27382024-11-25T19:32:46.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27392024-11-25T19:32:46.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27402024-11-25T19:32:46.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27412024-11-25T19:32:46.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 5e003d63-2bcc-47e6-918f-2aa3a7f45d69 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
27422024-11-25T19:32:46.911ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 64.067657ms iteration = 4 status = 0
27432024-11-25T19:32:46.919ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
27442024-11-25T19:32:46.919ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.071934ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
27452024-11-25T19:32:46.921ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
27462024-11-25T19:32:46.921ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27472024-11-25T19:32:46.921ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd3ccff8-527d-46a3-b850-5087c551154e", "content-length": "26", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
27482024-11-25T19:32:46.921ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27492024-11-25T19:32:46.923ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27502024-11-25T19:32:46.931ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27512024-11-25T19:32:46.931ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27522024-11-25T19:32:46.931ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 83.792594ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
27532024-11-25T19:32:46.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 87.529927ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27542024-11-25T19:32:46.937ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27552024-11-25T19:32:46.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27562024-11-25T19:32:46.939ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 92.176008ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
27572024-11-25T19:32:46.953ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27582024-11-25T19:32:46.953ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 105.636792ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27592024-11-25T19:32:46.967ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 119.499924ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
27602024-11-25T19:32:46.967ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
27612024-11-25T19:32:46.967ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27622024-11-25T19:32:46.968ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6ba6aee-a8e9-4a0e-8ef5-41bbc3bf7eb7", "content-length": "26", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
27632024-11-25T19:32:46.968ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27642024-11-25T19:32:46.968ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
27652024-11-25T19:32:46.968ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27662024-11-25T19:32:46.969ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "360dcf00-9feb-4253-8fea-2dbdd31360bb", "content-length": "26", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
27672024-11-25T19:32:46.969ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27682024-11-25T19:32:46.969ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27692024-11-25T19:32:46.970ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
27702024-11-25T19:32:46.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27712024-11-25T19:32:46.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27722024-11-25T19:32:47.008ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 160.332786ms iteration = 6 status = {"physical_disks_added":0}
27732024-11-25T19:32:47.054ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 206.95423ms iteration = 4 status = {}
27742024-11-25T19:32:47.077ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27752024-11-25T19:32:47.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27762024-11-25T19:32:47.079ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27772024-11-25T19:32:47.080ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27782024-11-25T19:32:47.080ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "30441169-5830-4cf3-b5b3-dcf4f5277d3d", "content-length": "1", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
27792024-11-25T19:32:47.082ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27802024-11-25T19:32:47.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27812024-11-25T19:32:47.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27822024-11-25T19:32:47.082ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27832024-11-25T19:32:47.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27842024-11-25T19:32:47.084ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27852024-11-25T19:32:47.085ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 237.352657ms iteration = 4 status = null
27862024-11-25T19:32:47.090ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27872024-11-25T19:32:47.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27882024-11-25T19:32:47.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27892024-11-25T19:32:47.090ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
27902024-11-25T19:32:47.090ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27912024-11-25T19:32:47.091ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a29b5eb-008b-4ddd-8d07-790633d85670", "content-length": "372", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
27922024-11-25T19:32:47.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27932024-11-25T19:32:47.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27942024-11-25T19:32:47.149ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
27952024-11-25T19:32:47.149ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
27962024-11-25T19:32:47.150ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6450737b-f582-439e-aee1-f189951331e5", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
27972024-11-25T19:32:47.150ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27982024-11-25T19:32:47.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27992024-11-25T19:32:47.152ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28002024-11-25T19:32:47.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28012024-11-25T19:32:47.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28022024-11-25T19:32:47.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28032024-11-25T19:32:47.160ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28042024-11-25T19:32:47.160ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28052024-11-25T19:32:47.160ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "046a512a-3953-4c6a-85aa-b33f10ba8f7f", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
28062024-11-25T19:32:47.161ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 313.993601ms iteration = 4 status = {}
28072024-11-25T19:32:47.177ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28082024-11-25T19:32:47.177ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a430207-9583-4dc2-a9e4-7df04d1d27d2", "content-length": "691", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
28092024-11-25T19:32:47.177ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
28102024-11-25T19:32:47.177ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
28112024-11-25T19:32:47.177ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
28122024-11-25T19:32:47.179ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 331.485153ms iteration = 4 status = {}
28132024-11-25T19:32:47.190ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28142024-11-25T19:32:47.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28152024-11-25T19:32:47.193ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
28162024-11-25T19:32:47.193ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28172024-11-25T19:32:47.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28182024-11-25T19:32:47.203ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28192024-11-25T19:32:47.203ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e905112a-fb47-4e2f-990e-d4ea56e043cf", "content-length": "134", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
28202024-11-25T19:32:47.204ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
28212024-11-25T19:32:47.204ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
28222024-11-25T19:32:47.204ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
28232024-11-25T19:32:47.204ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28242024-11-25T19:32:47.204ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28252024-11-25T19:32:47.204ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28262024-11-25T19:32:47.204ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28272024-11-25T19:32:47.204ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28282024-11-25T19:32:47.204ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28292024-11-25T19:32:47.204ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28302024-11-25T19:32:47.204ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
28312024-11-25T19:32:47.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28322024-11-25T19:32:47.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28332024-11-25T19:32:47.207ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
28342024-11-25T19:32:47.207ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "88fe046e-6edb-4425-aef9-c1bacfc00ba0", "content-length": "2", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
28352024-11-25T19:32:47.207ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
28362024-11-25T19:32:47.207ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "10a5568d-ce0c-464c-91cd-4b3bec97017d", "content-length": "51", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
28372024-11-25T19:32:47.207ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
28382024-11-25T19:32:47.207ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
28392024-11-25T19:32:47.299ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dcea440f-09ff-4c43-81e3-8822bee5246d", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
28402024-11-25T19:32:47.299ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
28412024-11-25T19:32:47.299ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28422024-11-25T19:32:47.299ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c58a4278-4fc5-49e7-97ac-ec74c8de97d8", "content-length": "682", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
28432024-11-25T19:32:47.299ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28442024-11-25T19:32:47.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28452024-11-25T19:32:47.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28462024-11-25T19:32:47.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28472024-11-25T19:32:47.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28482024-11-25T19:32:47.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28492024-11-25T19:32:47.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28502024-11-25T19:32:47.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28512024-11-25T19:32:47.316ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 468.878539ms iteration = 4 status = {}
28522024-11-25T19:32:47.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 79071507-47c1-4792-b4d1-638c0e0ecda0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28532024-11-25T19:32:47.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 79071507-47c1-4792-b4d1-638c0e0ecda0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28542024-11-25T19:32:47.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 79071507-47c1-4792-b4d1-638c0e0ecda0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28552024-11-25T19:32:48.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3d423ca1-65ff-44ef-8d28-695f338d0f18 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28562024-11-25T19:32:48.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3d423ca1-65ff-44ef-8d28-695f338d0f18 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28572024-11-25T19:32:48.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3d423ca1-65ff-44ef-8d28-695f338d0f18 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28582024-11-25T19:32:49.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6b051b58-6b7c-4a91-a20a-110af70d8866 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28592024-11-25T19:32:49.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6b051b58-6b7c-4a91-a20a-110af70d8866 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28602024-11-25T19:32:49.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6b051b58-6b7c-4a91-a20a-110af70d8866 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28612024-11-25T19:32:50.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3286ffd0-060d-432c-9bb2-00f8bc53c45c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28622024-11-25T19:32:50.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3286ffd0-060d-432c-9bb2-00f8bc53c45c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28632024-11-25T19:32:50.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3286ffd0-060d-432c-9bb2-00f8bc53c45c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28642024-11-25T19:32:51.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 80d26049-0ca8-4d06-91aa-cc42291bc2ae roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28652024-11-25T19:32:51.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 80d26049-0ca8-4d06-91aa-cc42291bc2ae resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28662024-11-25T19:32:51.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 80d26049-0ca8-4d06-91aa-cc42291bc2ae response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28672024-11-25T19:32:52.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 7e275e4c-00da-44c3-933c-f16c17e0d461 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
28682024-11-25T19:32:52.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 7e275e4c-00da-44c3-933c-f16c17e0d461 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
28692024-11-25T19:32:52.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 7e275e4c-00da-44c3-933c-f16c17e0d461 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
28702024-11-25T19:32:52.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 56e88234-dad0-4be9-a4ab-847acd53d857 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
28712024-11-25T19:32:52.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 56e88234-dad0-4be9-a4ab-847acd53d857 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
28722024-11-25T19:32:52.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 56e88234-dad0-4be9-a4ab-847acd53d857 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
28732024-11-25T19:32:52.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 459 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 001fb72c-24f7-4598-94e2-0704caef876b response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
28742024-11-25T19:32:52.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 955319dc-cbce-4538-a6b1-984d316e20a4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28752024-11-25T19:32:52.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 955319dc-cbce-4538-a6b1-984d316e20a4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28762024-11-25T19:32:52.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 955319dc-cbce-4538-a6b1-984d316e20a4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28772024-11-25T19:32:53.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 248667d2-613f-469f-93ab-5e7b523d5f21 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28782024-11-25T19:32:53.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 248667d2-613f-469f-93ab-5e7b523d5f21 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28792024-11-25T19:32:53.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 248667d2-613f-469f-93ab-5e7b523d5f21 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28802024-11-25T19:32:54.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c13a72aa-e338-40c6-9c08-f0b7e8589949 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28812024-11-25T19:32:54.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c13a72aa-e338-40c6-9c08-f0b7e8589949 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28822024-11-25T19:32:54.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c13a72aa-e338-40c6-9c08-f0b7e8589949 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28832024-11-25T19:32:55.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 34abbbc2-6a40-4f6f-87fb-d0043737415a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28842024-11-25T19:32:55.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 34abbbc2-6a40-4f6f-87fb-d0043737415a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28852024-11-25T19:32:55.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 34abbbc2-6a40-4f6f-87fb-d0043737415a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
28862024-11-25T19:32:56.847ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
28872024-11-25T19:32:56.847ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
28882024-11-25T19:32:56.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28892024-11-25T19:32:56.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28902024-11-25T19:32:56.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28912024-11-25T19:32:56.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28922024-11-25T19:32:56.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28932024-11-25T19:32:56.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28942024-11-25T19:32:56.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28952024-11-25T19:32:56.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.020679ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28962024-11-25T19:32:56.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28972024-11-25T19:32:56.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28982024-11-25T19:32:56.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28992024-11-25T19:32:56.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29002024-11-25T19:32:56.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29012024-11-25T19:32:56.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29022024-11-25T19:32:56.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
29032024-11-25T19:32:56.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29042024-11-25T19:32:56.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29052024-11-25T19:32:56.869ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
29062024-11-25T19:32:56.869ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.203516ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
29072024-11-25T19:32:56.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 349ae604-d680-4930-b446-3a2d6126384c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29082024-11-25T19:32:56.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 349ae604-d680-4930-b446-3a2d6126384c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29092024-11-25T19:32:56.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 349ae604-d680-4930-b446-3a2d6126384c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29102024-11-25T19:32:57.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9149d4b3-fea7-4e0d-bb3b-6ccc485dcdde roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29112024-11-25T19:32:57.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9149d4b3-fea7-4e0d-bb3b-6ccc485dcdde resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29122024-11-25T19:32:57.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9149d4b3-fea7-4e0d-bb3b-6ccc485dcdde response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29132024-11-25T19:32:58.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = edce36a5-baed-448f-b864-cb89d6a9979f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29142024-11-25T19:32:58.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = edce36a5-baed-448f-b864-cb89d6a9979f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29152024-11-25T19:32:58.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1677 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = edce36a5-baed-448f-b864-cb89d6a9979f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29162024-11-25T19:32:59.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bf38c2a1-9fc9-41a7-9f68-80c6a138f605 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29172024-11-25T19:32:59.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bf38c2a1-9fc9-41a7-9f68-80c6a138f605 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29182024-11-25T19:32:59.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bf38c2a1-9fc9-41a7-9f68-80c6a138f605 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29192024-11-25T19:33:00.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 684bdbdc-69a2-4f76-b39c-58acf83a5d29 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29202024-11-25T19:33:00.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 684bdbdc-69a2-4f76-b39c-58acf83a5d29 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29212024-11-25T19:33:00.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 684bdbdc-69a2-4f76-b39c-58acf83a5d29 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29222024-11-25T19:33:01.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0bbe8b7b-0b0f-4608-b3a9-a655c4b1b405 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29232024-11-25T19:33:01.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0bbe8b7b-0b0f-4608-b3a9-a655c4b1b405 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29242024-11-25T19:33:01.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0bbe8b7b-0b0f-4608-b3a9-a655c4b1b405 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29252024-11-25T19:33:02.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 469 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = a7a2f8a0-7612-4031-af5d-b2c1d1e50d5f response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
29262024-11-25T19:33:03.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d7b4907e-0ff9-48e1-8556-201fa9b7ea1e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29272024-11-25T19:33:03.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d7b4907e-0ff9-48e1-8556-201fa9b7ea1e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29282024-11-25T19:33:03.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d7b4907e-0ff9-48e1-8556-201fa9b7ea1e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29292024-11-25T19:33:04.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5851891-5c76-4b0f-b047-4145e398a0f7 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29302024-11-25T19:33:04.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5851891-5c76-4b0f-b047-4145e398a0f7 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29312024-11-25T19:33:04.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5851891-5c76-4b0f-b047-4145e398a0f7 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29322024-11-25T19:33:05.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b8bc3e63-a20a-4212-8437-933a3acebc1d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29332024-11-25T19:33:05.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b8bc3e63-a20a-4212-8437-933a3acebc1d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29342024-11-25T19:33:05.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b8bc3e63-a20a-4212-8437-933a3acebc1d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29352024-11-25T19:33:06.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 78686afc-aef9-4776-99f6-3f89ff19903e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29362024-11-25T19:33:06.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 78686afc-aef9-4776-99f6-3f89ff19903e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29372024-11-25T19:33:06.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 78686afc-aef9-4776-99f6-3f89ff19903e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29382024-11-25T19:33:06.847ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
29392024-11-25T19:33:06.847ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
29402024-11-25T19:33:06.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29412024-11-25T19:33:06.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29422024-11-25T19:33:06.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29432024-11-25T19:33:06.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29442024-11-25T19:33:06.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29452024-11-25T19:33:06.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29462024-11-25T19:33:06.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29472024-11-25T19:33:06.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.265244ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29482024-11-25T19:33:06.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29492024-11-25T19:33:06.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29502024-11-25T19:33:06.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29512024-11-25T19:33:06.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29522024-11-25T19:33:06.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29532024-11-25T19:33:06.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29542024-11-25T19:33:06.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
29552024-11-25T19:33:06.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29562024-11-25T19:33:06.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29572024-11-25T19:33:06.866ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
29582024-11-25T19:33:06.866ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.323609ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
29592024-11-25T19:33:07.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 733a46a2-da6f-4467-bc94-938cc7b00d62 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29602024-11-25T19:33:07.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 733a46a2-da6f-4467-bc94-938cc7b00d62 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29612024-11-25T19:33:07.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1806 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 733a46a2-da6f-4467-bc94-938cc7b00d62 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29622024-11-25T19:33:08.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9ad7caac-01db-4948-b2f8-19e07a03b3d2 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29632024-11-25T19:33:08.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9ad7caac-01db-4948-b2f8-19e07a03b3d2 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29642024-11-25T19:33:08.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9ad7caac-01db-4948-b2f8-19e07a03b3d2 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29652024-11-25T19:33:09.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9c5ccef7-5d85-4d23-b877-7149d4df17f1 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29662024-11-25T19:33:09.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9c5ccef7-5d85-4d23-b877-7149d4df17f1 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29672024-11-25T19:33:09.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9c5ccef7-5d85-4d23-b877-7149d4df17f1 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29682024-11-25T19:33:10.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ff2d441d-67b3-4b23-8bf7-c1f41c357bf5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29692024-11-25T19:33:10.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ff2d441d-67b3-4b23-8bf7-c1f41c357bf5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29702024-11-25T19:33:10.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ff2d441d-67b3-4b23-8bf7-c1f41c357bf5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29712024-11-25T19:33:11.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 37a5c559-ebe0-410b-b5f3-22aae0cb0e4f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29722024-11-25T19:33:11.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 37a5c559-ebe0-410b-b5f3-22aae0cb0e4f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29732024-11-25T19:33:11.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 37a5c559-ebe0-410b-b5f3-22aae0cb0e4f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29742024-11-25T19:33:12.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9f01be17-63f9-49a1-8e8b-63046b736e43 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29752024-11-25T19:33:12.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9f01be17-63f9-49a1-8e8b-63046b736e43 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29762024-11-25T19:33:12.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9f01be17-63f9-49a1-8e8b-63046b736e43 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29772024-11-25T19:33:12.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 627 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 65f82692-9d55-4e8b-bca6-090bdf3ccfc9 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
29782024-11-25T19:33:13.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ee9f6ca6-7671-4312-af73-760e8cc240c6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29792024-11-25T19:33:13.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ee9f6ca6-7671-4312-af73-760e8cc240c6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29802024-11-25T19:33:13.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ee9f6ca6-7671-4312-af73-760e8cc240c6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29812024-11-25T19:33:14.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b3e2641f-3357-47a4-afc0-4491faacfb7c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29822024-11-25T19:33:14.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b3e2641f-3357-47a4-afc0-4491faacfb7c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29832024-11-25T19:33:14.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b3e2641f-3357-47a4-afc0-4491faacfb7c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29842024-11-25T19:33:15.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ec0e1ea3-ee00-432b-9bbb-b29d474efd48 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29852024-11-25T19:33:15.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ec0e1ea3-ee00-432b-9bbb-b29d474efd48 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29862024-11-25T19:33:15.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ec0e1ea3-ee00-432b-9bbb-b29d474efd48 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29872024-11-25T19:33:16.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ec4dd3a0-7160-4b17-9c73-52f32704ee31 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29882024-11-25T19:33:16.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ec4dd3a0-7160-4b17-9c73-52f32704ee31 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29892024-11-25T19:33:16.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ec4dd3a0-7160-4b17-9c73-52f32704ee31 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
29902024-11-25T19:33:16.847ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
29912024-11-25T19:33:16.847ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29922024-11-25T19:33:16.847ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
29932024-11-25T19:33:16.847ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
29942024-11-25T19:33:16.847ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
29952024-11-25T19:33:16.847ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29962024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29972024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
29982024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
29992024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
30002024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30012024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
30022024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
30032024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
30042024-11-25T19:33:16.848ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:23:16.847987079 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
30052024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
30062024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
30072024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
30082024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30092024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30102024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30112024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
30122024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30132024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
30142024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30152024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
30162024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
30172024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
30182024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30192024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
30202024-11-25T19:33:16.848ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
30212024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30222024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
30232024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
30242024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
30252024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
30262024-11-25T19:33:16.848ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
30272024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.61\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
30282024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
30292024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
30302024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
30312024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
30322024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30332024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
30342024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
30352024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30362024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
30372024-11-25T19:33:16.848ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
30382024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30392024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
30402024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30412024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
30422024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
30432024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
30442024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
30452024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
30462024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
30472024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30482024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30492024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
30502024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30512024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30522024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30532024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
30542024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
30552024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30562024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30572024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30582024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30592024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
30602024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30612024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30622024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30632024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
30642024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30652024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30662024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
30672024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30682024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30692024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30702024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30712024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30722024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30732024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30742024-11-25T19:33:16.848ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1222, tv_nsec: 395856063 } })
30752024-11-25T19:33:16.848ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1222, tv_nsec: 395858323 } })
30762024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30772024-11-25T19:33:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
30782024-11-25T19:33:16.849ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
30792024-11-25T19:33:16.849ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.210814ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
30802024-11-25T19:33:16.849ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
30812024-11-25T19:33:16.849ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.244724ms iteration = 3 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
30822024-11-25T19:33:16.850ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1222, tv_nsec: 397405603 } })
30832024-11-25T19:33:16.850ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
30842024-11-25T19:33:16.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30852024-11-25T19:33:16.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30862024-11-25T19:33:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30872024-11-25T19:33:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30882024-11-25T19:33:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.60678ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
30892024-11-25T19:33:16.853ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.877536ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
30902024-11-25T19:33:16.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30912024-11-25T19:33:16.853ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:23:16.847987079 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
30922024-11-25T19:33:16.853ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.935316ms iteration = 3 status = {"expiration":"2024-11-25T19:23:16.847987079Z","pruned":[]}
30932024-11-25T19:33:16.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30942024-11-25T19:33:16.854ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30952024-11-25T19:33:16.854ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
30962024-11-25T19:33:16.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30972024-11-25T19:33:16.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30982024-11-25T19:33:16.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30992024-11-25T19:33:16.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31002024-11-25T19:33:16.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31012024-11-25T19:33:16.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31022024-11-25T19:33:16.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31032024-11-25T19:33:16.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31042024-11-25T19:33:16.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31052024-11-25T19:33:16.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31062024-11-25T19:33:16.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31072024-11-25T19:33:16.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31082024-11-25T19:33:16.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31092024-11-25T19:33:16.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31102024-11-25T19:33:16.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31112024-11-25T19:33:16.863ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1222, tv_nsec: 410327947 } })
31122024-11-25T19:33:16.863ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
31132024-11-25T19:33:16.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31142024-11-25T19:33:16.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31152024-11-25T19:33:16.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31162024-11-25T19:33:16.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31172024-11-25T19:33:16.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31182024-11-25T19:33:16.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31192024-11-25T19:33:16.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31202024-11-25T19:33:16.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31212024-11-25T19:33:16.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31222024-11-25T19:33:16.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31232024-11-25T19:33:16.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31242024-11-25T19:33:16.883ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31252024-11-25T19:33:16.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31262024-11-25T19:33:16.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31272024-11-25T19:33:16.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31282024-11-25T19:33:16.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31292024-11-25T19:33:16.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31302024-11-25T19:33:16.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31312024-11-25T19:33:16.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
31322024-11-25T19:33:16.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31332024-11-25T19:33:16.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31342024-11-25T19:33:16.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31352024-11-25T19:33:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31362024-11-25T19:33:16.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31372024-11-25T19:33:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31382024-11-25T19:33:16.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.447909ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
31392024-11-25T19:33:16.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.526408ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
31402024-11-25T19:33:16.908ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31412024-11-25T19:33:16.909ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31422024-11-25T19:33:16.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31432024-11-25T19:33:16.910ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1222, tv_nsec: 457657055 } })
31442024-11-25T19:33:16.911ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
31452024-11-25T19:33:16.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31462024-11-25T19:33:16.911ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31472024-11-25T19:33:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31482024-11-25T19:33:16.912ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
31492024-11-25T19:33:16.912ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
31502024-11-25T19:33:16.912ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.819512ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
31512024-11-25T19:33:16.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31522024-11-25T19:33:16.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31532024-11-25T19:33:16.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31542024-11-25T19:33:16.917ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31552024-11-25T19:33:16.917ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31562024-11-25T19:33:16.917ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31572024-11-25T19:33:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31582024-11-25T19:33:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31592024-11-25T19:33:16.918ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31602024-11-25T19:33:16.918ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 70.444032ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
31612024-11-25T19:33:16.918ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
31622024-11-25T19:33:16.918ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.523823ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
31632024-11-25T19:33:16.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31642024-11-25T19:33:16.919ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31652024-11-25T19:33:16.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31662024-11-25T19:33:16.921ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31672024-11-25T19:33:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31682024-11-25T19:33:16.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31692024-11-25T19:33:16.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31702024-11-25T19:33:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31712024-11-25T19:33:16.921ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
31722024-11-25T19:33:16.921ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
31732024-11-25T19:33:16.921ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
31742024-11-25T19:33:16.921ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31752024-11-25T19:33:16.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31762024-11-25T19:33:16.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31772024-11-25T19:33:16.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31782024-11-25T19:33:16.923ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31792024-11-25T19:33:16.923ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 74.90489ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
31802024-11-25T19:33:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31812024-11-25T19:33:16.923ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31822024-11-25T19:33:16.923ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31832024-11-25T19:33:16.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31842024-11-25T19:33:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31852024-11-25T19:33:16.924ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31862024-11-25T19:33:16.925ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 76.742225ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31872024-11-25T19:33:16.926ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
31882024-11-25T19:33:16.926ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
31892024-11-25T19:33:16.926ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
31902024-11-25T19:33:16.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31912024-11-25T19:33:16.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
31922024-11-25T19:33:16.926ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31932024-11-25T19:33:16.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31942024-11-25T19:33:16.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31952024-11-25T19:33:16.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
31962024-11-25T19:33:16.928ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31972024-11-25T19:33:16.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31982024-11-25T19:33:16.928ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 80.288575ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
31992024-11-25T19:33:16.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32002024-11-25T19:33:16.928ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32012024-11-25T19:33:16.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32022024-11-25T19:33:16.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32032024-11-25T19:33:16.931ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
32042024-11-25T19:33:16.931ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
32052024-11-25T19:33:16.931ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32062024-11-25T19:33:16.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32072024-11-25T19:33:16.931ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32082024-11-25T19:33:16.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32092024-11-25T19:33:16.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32102024-11-25T19:33:16.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32112024-11-25T19:33:16.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32122024-11-25T19:33:16.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32132024-11-25T19:33:16.934ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32142024-11-25T19:33:16.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32152024-11-25T19:33:16.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32162024-11-25T19:33:16.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32172024-11-25T19:33:16.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32182024-11-25T19:33:16.938ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32192024-11-25T19:33:16.939ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
32202024-11-25T19:33:16.939ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
32212024-11-25T19:33:16.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32222024-11-25T19:33:16.939ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32232024-11-25T19:33:16.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32242024-11-25T19:33:16.939ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
32252024-11-25T19:33:16.939ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
32262024-11-25T19:33:16.939ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
32272024-11-25T19:33:16.939ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 91.234949ms iteration = 3 status = {"generation":2}
32282024-11-25T19:33:16.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32292024-11-25T19:33:16.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = ed78a345-463b-4cf9-a860-9219e5d1bc1c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
32302024-11-25T19:33:16.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = ed78a345-463b-4cf9-a860-9219e5d1bc1c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
32312024-11-25T19:33:16.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
32322024-11-25T19:33:16.942ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32332024-11-25T19:33:16.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32342024-11-25T19:33:16.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32352024-11-25T19:33:16.946ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.556234ms iteration = 5 status = 0
32362024-11-25T19:33:16.948ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32372024-11-25T19:33:16.948ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32382024-11-25T19:33:16.948ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32392024-11-25T19:33:16.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32402024-11-25T19:33:16.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32412024-11-25T19:33:16.948ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.757477ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32422024-11-25T19:33:16.950ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32432024-11-25T19:33:16.952ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32442024-11-25T19:33:16.952ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32452024-11-25T19:33:16.952ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.177614ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
32462024-11-25T19:33:16.952ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32472024-11-25T19:33:16.952ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32482024-11-25T19:33:16.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32492024-11-25T19:33:16.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = ed78a345-463b-4cf9-a860-9219e5d1bc1c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
32502024-11-25T19:33:16.961ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
32512024-11-25T19:33:16.961ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
32522024-11-25T19:33:16.961ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 113.363634ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
32532024-11-25T19:33:16.964ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32542024-11-25T19:33:16.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32552024-11-25T19:33:16.965ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32562024-11-25T19:33:16.967ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32572024-11-25T19:33:16.967ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32582024-11-25T19:33:16.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32592024-11-25T19:33:16.972ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32602024-11-25T19:33:16.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32612024-11-25T19:33:16.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32622024-11-25T19:33:16.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32632024-11-25T19:33:16.978ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
32642024-11-25T19:33:16.996ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 147.991173ms iteration = 7 status = {"physical_disks_added":0}
32652024-11-25T19:33:17.000ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
32662024-11-25T19:33:17.000ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 152.621024ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
32672024-11-25T19:33:17.029ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
32682024-11-25T19:33:17.029ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32692024-11-25T19:33:17.029ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c7373ab-6454-45a1-b7a4-a1ad45435c0e", "content-length": "26", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
32702024-11-25T19:33:17.029ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32712024-11-25T19:33:17.031ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32722024-11-25T19:33:17.116ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
32732024-11-25T19:33:17.116ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32742024-11-25T19:33:17.118ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a1885bb-6e60-4b36-a7bb-c6db68e85c26", "content-length": "26", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
32752024-11-25T19:33:17.118ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32762024-11-25T19:33:17.121ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
32772024-11-25T19:33:17.159ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32782024-11-25T19:33:17.159ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32792024-11-25T19:33:17.160ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e99da79-58da-4d9d-97b3-026338a709ea", "content-length": "372", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
32802024-11-25T19:33:17.160ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32812024-11-25T19:33:17.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32822024-11-25T19:33:17.163ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
32832024-11-25T19:33:17.186ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32842024-11-25T19:33:17.186ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e80b6f3d-0b72-496c-90e1-666ba725e543", "content-length": "691", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
32852024-11-25T19:33:17.186ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
32862024-11-25T19:33:17.186ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
32872024-11-25T19:33:17.186ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
32882024-11-25T19:33:17.188ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 340.518501ms iteration = 5 status = {}
32892024-11-25T19:33:17.189ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
32902024-11-25T19:33:17.189ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
32912024-11-25T19:33:17.189ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
32922024-11-25T19:33:17.189ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 342.01069ms iteration = 3 status = {"generation":1}
32932024-11-25T19:33:17.215ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
32942024-11-25T19:33:17.215ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32952024-11-25T19:33:17.216ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "205dca77-03b1-401c-89a1-cd9f3c6e2000", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
32962024-11-25T19:33:17.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32972024-11-25T19:33:17.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32982024-11-25T19:33:17.219ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32992024-11-25T19:33:17.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33002024-11-25T19:33:17.220ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
33012024-11-25T19:33:17.220ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33022024-11-25T19:33:17.220ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "03c4b8c0-bcb3-4198-8848-b583690a1d10", "content-length": "26", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
33032024-11-25T19:33:17.220ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33042024-11-25T19:33:17.222ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33052024-11-25T19:33:17.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33062024-11-25T19:33:17.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33072024-11-25T19:33:17.225ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
33082024-11-25T19:33:17.225ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 377.337714ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
33092024-11-25T19:33:17.226ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33102024-11-25T19:33:17.226ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33112024-11-25T19:33:17.227ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ce25545b-cd25-43be-ac03-6b5b246f9844", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
33122024-11-25T19:33:17.228ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 380.679199ms iteration = 5 status = {}
33132024-11-25T19:33:17.239ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
33142024-11-25T19:33:17.268ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
33152024-11-25T19:33:17.270ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "25ab0cd7-b593-4ecf-afa7-138bf6858bb9", "content-length": "1", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
33162024-11-25T19:33:17.271ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33172024-11-25T19:33:17.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33182024-11-25T19:33:17.273ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 425.853715ms iteration = 5 status = null
33192024-11-25T19:33:17.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cf36b1dc-e01c-4465-966e-a2b6e9173cc0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
33202024-11-25T19:33:17.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cf36b1dc-e01c-4465-966e-a2b6e9173cc0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
33212024-11-25T19:33:17.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cf36b1dc-e01c-4465-966e-a2b6e9173cc0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
33222024-11-25T19:33:17.328ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
33232024-11-25T19:33:17.329ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "efa73ca0-e7e8-43be-9813-a508eb9dc06d", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33242024-11-25T19:33:17.329ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33252024-11-25T19:33:17.330ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b11ce681-86a7-45e2-a8fb-fa7f8dffe679", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33262024-11-25T19:33:17.330ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33272024-11-25T19:33:17.331ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33282024-11-25T19:33:17.331ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 483.68267ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
33292024-11-25T19:33:17.346ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 498.47508ms iteration = 5 status = {}
33302024-11-25T19:33:17.424ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
33312024-11-25T19:33:17.424ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b68fe0ef-29db-4572-a33d-a5e759b89998", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
33322024-11-25T19:33:17.424ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
33332024-11-25T19:33:17.426ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "fdf62be4-6e69-4855-8a50-0b0b34a8e507", "date": "Mon, 25 Nov 2024 19:33:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
33342024-11-25T19:33:17.426ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
33352024-11-25T19:33:17.428ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9fad0142-d69f-4095-90cc-fc43bbddf80a", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
33362024-11-25T19:33:17.428ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
33372024-11-25T19:33:17.430ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
33382024-11-25T19:33:17.430ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 581.985099ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
33392024-11-25T19:33:17.473ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33402024-11-25T19:33:17.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33412024-11-25T19:33:17.476ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
33422024-11-25T19:33:17.476ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33432024-11-25T19:33:17.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33442024-11-25T19:33:17.535ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
33452024-11-25T19:33:17.536ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d8a812a-6eaa-43c8-91cd-c96fab69e903", "content-length": "134", "date": "Mon, 25 Nov 2024 19:33:17 GMT"} })
33462024-11-25T19:33:17.536ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
33472024-11-25T19:33:17.536ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
33482024-11-25T19:33:17.536ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
33492024-11-25T19:33:17.536ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33502024-11-25T19:33:17.536ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33512024-11-25T19:33:17.536ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33522024-11-25T19:33:17.536ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33532024-11-25T19:33:17.536ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33542024-11-25T19:33:17.536ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33552024-11-25T19:33:17.536ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33562024-11-25T19:33:17.536ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
33572024-11-25T19:33:17.536ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33582024-11-25T19:33:17.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33592024-11-25T19:33:17.539ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
33602024-11-25T19:33:17.539ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1823ba9e-fc0d-4394-a4ee-e169a509c990", "content-length": "2", "date": "Mon, 25 Nov 2024 19:33:17 GMT"} })
33612024-11-25T19:33:17.539ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
33622024-11-25T19:33:17.539ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c11d0656-1c75-43f2-9e27-71336fae978f", "content-length": "51", "date": "Mon, 25 Nov 2024 19:33:17 GMT"} })
33632024-11-25T19:33:17.539ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
33642024-11-25T19:33:17.539ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33652024-11-25T19:33:17.699ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "676cbddd-9742-476b-90c6-771129cd300f", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
33662024-11-25T19:33:17.699ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
33672024-11-25T19:33:17.699ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33682024-11-25T19:33:17.699ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "db0e8729-f0b9-4b48-b812-1e131b5bbfc8", "content-length": "682", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
33692024-11-25T19:33:17.699ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33702024-11-25T19:33:17.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33712024-11-25T19:33:17.708ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33722024-11-25T19:33:17.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33732024-11-25T19:33:17.711ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33742024-11-25T19:33:17.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33752024-11-25T19:33:17.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33762024-11-25T19:33:17.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33772024-11-25T19:33:17.720ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 872.839946ms iteration = 5 status = {}
33782024-11-25T19:33:18.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 79f87658-03a7-4f6a-a8df-5011dd115171 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
33792024-11-25T19:33:18.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 79f87658-03a7-4f6a-a8df-5011dd115171 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
33802024-11-25T19:33:18.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 79f87658-03a7-4f6a-a8df-5011dd115171 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
33812024-11-25T19:33:19.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1308d9ef-3465-4056-bc7d-fa7029e8678e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
33822024-11-25T19:33:19.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1308d9ef-3465-4056-bc7d-fa7029e8678e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
33832024-11-25T19:33:19.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1308d9ef-3465-4056-bc7d-fa7029e8678e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
33842024-11-25T19:33:20.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 542e8381-af64-401a-b4fd-15d1c52a34a9 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
33852024-11-25T19:33:20.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 542e8381-af64-401a-b4fd-15d1c52a34a9 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
33862024-11-25T19:33:20.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 542e8381-af64-401a-b4fd-15d1c52a34a9 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
33872024-11-25T19:33:21.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 320f4ff3-b33a-4d47-9dee-3ad15eab82db roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
33882024-11-25T19:33:21.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 320f4ff3-b33a-4d47-9dee-3ad15eab82db resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
33892024-11-25T19:33:21.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 320f4ff3-b33a-4d47-9dee-3ad15eab82db response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
33902024-11-25T19:33:22.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 48614621-e1ed-4881-999c-3b541299a07e roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
33912024-11-25T19:33:22.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 48614621-e1ed-4881-999c-3b541299a07e resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
33922024-11-25T19:33:22.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 48614621-e1ed-4881-999c-3b541299a07e response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
33932024-11-25T19:33:22.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = a200db7e-2820-4a63-a8c7-fda7b8f8ae45 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
33942024-11-25T19:33:22.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = a200db7e-2820-4a63-a8c7-fda7b8f8ae45 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
33952024-11-25T19:33:22.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = a200db7e-2820-4a63-a8c7-fda7b8f8ae45 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
33962024-11-25T19:33:22.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 517 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = e4504309-db87-42be-85df-e2081b9580c9 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
33972024-11-25T19:33:22.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 08c009d8-0b94-47b2-bee3-aa8aa5d961e5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
33982024-11-25T19:33:22.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 08c009d8-0b94-47b2-bee3-aa8aa5d961e5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
33992024-11-25T19:33:22.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 08c009d8-0b94-47b2-bee3-aa8aa5d961e5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34002024-11-25T19:33:23.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cc296f13-0e72-4022-86c1-96041d615a83 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34012024-11-25T19:33:23.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cc296f13-0e72-4022-86c1-96041d615a83 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34022024-11-25T19:33:23.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1905 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cc296f13-0e72-4022-86c1-96041d615a83 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34032024-11-25T19:33:24.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f6e19ed8-5d00-4d7b-beb1-284f6ea42a8d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34042024-11-25T19:33:24.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f6e19ed8-5d00-4d7b-beb1-284f6ea42a8d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34052024-11-25T19:33:24.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2711 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f6e19ed8-5d00-4d7b-beb1-284f6ea42a8d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34062024-11-25T19:33:25.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 219128c9-3ede-4e5d-816c-12678b751efc roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34072024-11-25T19:33:25.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 219128c9-3ede-4e5d-816c-12678b751efc resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34082024-11-25T19:33:25.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 219128c9-3ede-4e5d-816c-12678b751efc response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34092024-11-25T19:33:26.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d21b2ccc-cc41-4752-899f-870f2ad87346 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34102024-11-25T19:33:26.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d21b2ccc-cc41-4752-899f-870f2ad87346 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34112024-11-25T19:33:26.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d21b2ccc-cc41-4752-899f-870f2ad87346 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34122024-11-25T19:33:26.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
34132024-11-25T19:33:26.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
34142024-11-25T19:33:26.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34152024-11-25T19:33:26.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34162024-11-25T19:33:26.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34172024-11-25T19:33:26.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34182024-11-25T19:33:26.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34192024-11-25T19:33:26.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34202024-11-25T19:33:26.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34212024-11-25T19:33:26.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34222024-11-25T19:33:26.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34232024-11-25T19:33:26.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34242024-11-25T19:33:26.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34252024-11-25T19:33:26.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
34262024-11-25T19:33:26.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34272024-11-25T19:33:26.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34282024-11-25T19:33:26.878ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
34292024-11-25T19:33:26.878ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.07617ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
34302024-11-25T19:33:26.879ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34312024-11-25T19:33:26.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34322024-11-25T19:33:26.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.773791ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34332024-11-25T19:33:27.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 233e0973-aae5-497e-bd54-6d8929d38d77 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34342024-11-25T19:33:27.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 233e0973-aae5-497e-bd54-6d8929d38d77 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34352024-11-25T19:33:27.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 233e0973-aae5-497e-bd54-6d8929d38d77 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34362024-11-25T19:33:28.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8173fe20-0d34-426f-883c-4183fb1d39a1 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34372024-11-25T19:33:28.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8173fe20-0d34-426f-883c-4183fb1d39a1 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34382024-11-25T19:33:28.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8173fe20-0d34-426f-883c-4183fb1d39a1 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34392024-11-25T19:33:29.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a2e49f69-74a7-4cdf-bde2-e498c3949365 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34402024-11-25T19:33:29.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a2e49f69-74a7-4cdf-bde2-e498c3949365 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34412024-11-25T19:33:29.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a2e49f69-74a7-4cdf-bde2-e498c3949365 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34422024-11-25T19:33:30.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 25e46910-eb79-473c-afa7-3e9b3281e56f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34432024-11-25T19:33:30.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 25e46910-eb79-473c-afa7-3e9b3281e56f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34442024-11-25T19:33:30.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 25e46910-eb79-473c-afa7-3e9b3281e56f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34452024-11-25T19:33:31.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 11dcefab-6c54-4169-928a-a89d96c9c90c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34462024-11-25T19:33:31.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 11dcefab-6c54-4169-928a-a89d96c9c90c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34472024-11-25T19:33:31.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 11dcefab-6c54-4169-928a-a89d96c9c90c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34482024-11-25T19:33:32.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 522 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 308f2707-6f11-4aab-8e41-3634fae848a9 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
34492024-11-25T19:33:32.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5fb6e3da-b6fb-4562-be24-201b142469e4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34502024-11-25T19:33:32.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5fb6e3da-b6fb-4562-be24-201b142469e4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34512024-11-25T19:33:32.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5fb6e3da-b6fb-4562-be24-201b142469e4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34522024-11-25T19:33:33.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3d8247b8-07d8-4919-82cd-ea138b6d0ca5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34532024-11-25T19:33:33.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3d8247b8-07d8-4919-82cd-ea138b6d0ca5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34542024-11-25T19:33:33.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3d8247b8-07d8-4919-82cd-ea138b6d0ca5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34552024-11-25T19:33:34.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c9b6ffb2-cbfd-4414-b511-94d91893d30d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34562024-11-25T19:33:34.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c9b6ffb2-cbfd-4414-b511-94d91893d30d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34572024-11-25T19:33:34.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1785 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c9b6ffb2-cbfd-4414-b511-94d91893d30d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34582024-11-25T19:33:35.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 012e261c-44ce-402a-9aeb-76ddff3a7afb roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34592024-11-25T19:33:35.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 012e261c-44ce-402a-9aeb-76ddff3a7afb resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34602024-11-25T19:33:35.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 012e261c-44ce-402a-9aeb-76ddff3a7afb response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34612024-11-25T19:33:36.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5f78fd3-b0ed-4478-8f58-a0fa7fa5dc38 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34622024-11-25T19:33:36.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5f78fd3-b0ed-4478-8f58-a0fa7fa5dc38 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34632024-11-25T19:33:36.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5f78fd3-b0ed-4478-8f58-a0fa7fa5dc38 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34642024-11-25T19:33:36.847ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
34652024-11-25T19:33:36.847ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
34662024-11-25T19:33:36.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34672024-11-25T19:33:36.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34682024-11-25T19:33:36.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34692024-11-25T19:33:36.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34702024-11-25T19:33:36.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34712024-11-25T19:33:36.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34722024-11-25T19:33:36.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34732024-11-25T19:33:36.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34742024-11-25T19:33:36.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34752024-11-25T19:33:36.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34762024-11-25T19:33:36.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34772024-11-25T19:33:36.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34782024-11-25T19:33:36.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34792024-11-25T19:33:36.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
34802024-11-25T19:33:36.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34812024-11-25T19:33:36.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34822024-11-25T19:33:36.866ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
34832024-11-25T19:33:36.866ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.293888ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
34842024-11-25T19:33:36.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.026049ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34852024-11-25T19:33:37.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = e900e3a9-68f4-47f0-8633-07e0474f9460 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
34862024-11-25T19:33:37.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = e900e3a9-68f4-47f0-8633-07e0474f9460 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
34872024-11-25T19:33:37.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = e900e3a9-68f4-47f0-8633-07e0474f9460 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
34882024-11-25T19:33:37.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 1215bd09-f050-4232-a785-ae39b320bf1a roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
34892024-11-25T19:33:37.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 1215bd09-f050-4232-a785-ae39b320bf1a resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
34902024-11-25T19:33:37.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = 1215bd09-f050-4232-a785-ae39b320bf1a response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
34912024-11-25T19:33:37.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aa89dd78-f5a1-4c03-9d75-64096a7365ef roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34922024-11-25T19:33:37.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aa89dd78-f5a1-4c03-9d75-64096a7365ef resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34932024-11-25T19:33:37.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aa89dd78-f5a1-4c03-9d75-64096a7365ef response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34942024-11-25T19:33:38.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c3c8e634-e479-49b3-bbed-80c99416a80a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34952024-11-25T19:33:38.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c3c8e634-e479-49b3-bbed-80c99416a80a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34962024-11-25T19:33:38.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c3c8e634-e479-49b3-bbed-80c99416a80a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34972024-11-25T19:33:39.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f4478379-2507-4412-a80b-988e3d51e805 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34982024-11-25T19:33:39.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f4478379-2507-4412-a80b-988e3d51e805 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
34992024-11-25T19:33:39.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f4478379-2507-4412-a80b-988e3d51e805 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35002024-11-25T19:33:40.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4df4de69-a42a-4593-baf1-397090282db0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35012024-11-25T19:33:40.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4df4de69-a42a-4593-baf1-397090282db0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35022024-11-25T19:33:40.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4df4de69-a42a-4593-baf1-397090282db0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35032024-11-25T19:33:41.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b976b4a6-1432-4241-a56a-24910674c5d0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35042024-11-25T19:33:41.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b976b4a6-1432-4241-a56a-24910674c5d0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35052024-11-25T19:33:41.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b976b4a6-1432-4241-a56a-24910674c5d0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35062024-11-25T19:33:42.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 595 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 9f5b02c7-08f3-40dc-bd26-89998be93d77 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
35072024-11-25T19:33:42.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9cd77a2d-52fa-43c3-8c43-850d752338ee roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35082024-11-25T19:33:42.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9cd77a2d-52fa-43c3-8c43-850d752338ee resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35092024-11-25T19:33:42.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9cd77a2d-52fa-43c3-8c43-850d752338ee response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35102024-11-25T19:33:43.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7dc59627-f500-4339-a465-8312c1bbbac4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35112024-11-25T19:33:43.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7dc59627-f500-4339-a465-8312c1bbbac4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35122024-11-25T19:33:43.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7dc59627-f500-4339-a465-8312c1bbbac4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35132024-11-25T19:33:44.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 99a6d58e-15e4-487f-aca8-6e49da79877f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35142024-11-25T19:33:44.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 99a6d58e-15e4-487f-aca8-6e49da79877f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35152024-11-25T19:33:44.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 99a6d58e-15e4-487f-aca8-6e49da79877f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35162024-11-25T19:33:45.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c2c4e969-440a-454b-865f-732d1242bd23 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35172024-11-25T19:33:45.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c2c4e969-440a-454b-865f-732d1242bd23 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35182024-11-25T19:33:45.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1749 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c2c4e969-440a-454b-865f-732d1242bd23 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
35192024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
35202024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
35212024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35222024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
35232024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35242024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
35252024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35262024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35272024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
35282024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
35292024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35302024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
35312024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35322024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35332024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
35342024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
35352024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35362024-11-25T19:33:46.848ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35372024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35382024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
35392024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35402024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
35412024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
35422024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35432024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
35442024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35452024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
35462024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
35472024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35482024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
35492024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35502024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
35512024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
35522024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35532024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35542024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35552024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35562024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35572024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35582024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35592024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35602024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35612024-11-25T19:33:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35622024-11-25T19:33:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35632024-11-25T19:33:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35642024-11-25T19:33:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35652024-11-25T19:33:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35662024-11-25T19:33:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35672024-11-25T19:33:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35682024-11-25T19:33:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35692024-11-25T19:33:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35702024-11-25T19:33:46.851ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.229784ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35712024-11-25T19:33:46.851ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1252, tv_nsec: 398557796 } })
35722024-11-25T19:33:46.852ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
35732024-11-25T19:33:46.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35742024-11-25T19:33:46.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35752024-11-25T19:33:46.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1252, tv_nsec: 400991504 } })
35762024-11-25T19:33:46.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35772024-11-25T19:33:46.854ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35782024-11-25T19:33:46.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35792024-11-25T19:33:46.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35802024-11-25T19:33:46.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
35812024-11-25T19:33:46.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35822024-11-25T19:33:46.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35832024-11-25T19:33:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35842024-11-25T19:33:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35852024-11-25T19:33:46.857ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35862024-11-25T19:33:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35872024-11-25T19:33:46.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35882024-11-25T19:33:46.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35892024-11-25T19:33:46.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35902024-11-25T19:33:46.863ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1252, tv_nsec: 410507100 } })
35912024-11-25T19:33:46.864ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
35922024-11-25T19:33:46.864ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35932024-11-25T19:33:46.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35942024-11-25T19:33:46.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35952024-11-25T19:33:46.885ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35962024-11-25T19:33:46.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35972024-11-25T19:33:46.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35982024-11-25T19:33:46.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35992024-11-25T19:33:46.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36002024-11-25T19:33:46.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36012024-11-25T19:33:46.894ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36022024-11-25T19:33:46.894ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36032024-11-25T19:33:46.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36042024-11-25T19:33:46.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36052024-11-25T19:33:46.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36062024-11-25T19:33:46.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36072024-11-25T19:33:46.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36082024-11-25T19:33:46.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36092024-11-25T19:33:46.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36102024-11-25T19:33:46.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36112024-11-25T19:33:46.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36122024-11-25T19:33:46.899ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36132024-11-25T19:33:46.899ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36142024-11-25T19:33:46.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36152024-11-25T19:33:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36162024-11-25T19:33:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
36172024-11-25T19:33:46.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36182024-11-25T19:33:46.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36192024-11-25T19:33:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36202024-11-25T19:33:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36212024-11-25T19:33:46.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.563671ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
36222024-11-25T19:33:46.901ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36232024-11-25T19:33:46.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.079682ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
36242024-11-25T19:33:46.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36252024-11-25T19:33:46.903ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36262024-11-25T19:33:46.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36272024-11-25T19:33:46.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36282024-11-25T19:33:46.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36292024-11-25T19:33:46.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36302024-11-25T19:33:46.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36312024-11-25T19:33:46.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 56.55444ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
36322024-11-25T19:33:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
36332024-11-25T19:33:46.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36342024-11-25T19:33:46.906ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36352024-11-25T19:33:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36362024-11-25T19:33:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36372024-11-25T19:33:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36382024-11-25T19:33:46.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36392024-11-25T19:33:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36402024-11-25T19:33:46.909ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36412024-11-25T19:33:46.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36422024-11-25T19:33:46.909ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36432024-11-25T19:33:46.910ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 62.246871ms iteration = 6 status = 0
36442024-11-25T19:33:46.912ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
36452024-11-25T19:33:46.912ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 63.776341ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
36462024-11-25T19:33:46.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36472024-11-25T19:33:46.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36482024-11-25T19:33:46.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36492024-11-25T19:33:46.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.269546ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36502024-11-25T19:33:46.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 280d34f0-a9c6-4bef-b99e-faff846e8d68 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
36512024-11-25T19:33:46.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 280d34f0-a9c6-4bef-b99e-faff846e8d68 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
36522024-11-25T19:33:46.930ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36532024-11-25T19:33:46.930ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36542024-11-25T19:33:46.930ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 81.995588ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36552024-11-25T19:33:46.930ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36562024-11-25T19:33:46.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36572024-11-25T19:33:46.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 280d34f0-a9c6-4bef-b99e-faff846e8d68 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
36582024-11-25T19:33:46.939ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.71339ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36592024-11-25T19:33:46.944ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36602024-11-25T19:33:46.944ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 95.524094ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36612024-11-25T19:33:46.951ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
36622024-11-25T19:33:46.951ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36632024-11-25T19:33:46.951ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d9db768-6006-4190-b3fc-605814cecdf6", "content-length": "26", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
36642024-11-25T19:33:46.951ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36652024-11-25T19:33:46.953ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36662024-11-25T19:33:46.970ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 122.168977ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
36672024-11-25T19:33:46.983ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36682024-11-25T19:33:46.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36692024-11-25T19:33:46.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = eac53032-5c15-487e-8330-fc3454ad7b44 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
36702024-11-25T19:33:46.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = eac53032-5c15-487e-8330-fc3454ad7b44 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
36712024-11-25T19:33:46.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = eac53032-5c15-487e-8330-fc3454ad7b44 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
36722024-11-25T19:33:47.011ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 163.437446ms iteration = 8 status = {"physical_disks_added":0}
36732024-11-25T19:33:47.059ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
36742024-11-25T19:33:47.059ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36752024-11-25T19:33:47.060ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "751bbc59-22bc-483f-bddd-73d16e4b8b2c", "content-length": "26", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
36762024-11-25T19:33:47.060ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36772024-11-25T19:33:47.061ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
36782024-11-25T19:33:47.061ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36792024-11-25T19:33:47.062ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36802024-11-25T19:33:47.062ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcce406d-92e9-4679-937c-3e3610662fc4", "content-length": "372", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
36812024-11-25T19:33:47.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36822024-11-25T19:33:47.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36832024-11-25T19:33:47.069ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
36842024-11-25T19:33:47.069ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36852024-11-25T19:33:47.070ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca59c073-9c27-45d4-b2c3-2ec99fdbbbf7", "content-length": "26", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
36862024-11-25T19:33:47.070ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36872024-11-25T19:33:47.071ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
36882024-11-25T19:33:47.072ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36892024-11-25T19:33:47.072ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dbd2bcd-dee0-4dee-8b20-c679ae91b575", "content-length": "1", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
36902024-11-25T19:33:47.073ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36912024-11-25T19:33:47.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36922024-11-25T19:33:47.082ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 234.142854ms iteration = 6 status = null
36932024-11-25T19:33:47.083ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36942024-11-25T19:33:47.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36952024-11-25T19:33:47.120ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36962024-11-25T19:33:47.122ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36972024-11-25T19:33:47.122ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36982024-11-25T19:33:47.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36992024-11-25T19:33:47.128ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
37002024-11-25T19:33:47.128ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37012024-11-25T19:33:47.129ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "137bcb22-2f86-441e-b0ad-8b928bd908dd", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
37022024-11-25T19:33:47.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37032024-11-25T19:33:47.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37042024-11-25T19:33:47.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37052024-11-25T19:33:47.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37062024-11-25T19:33:47.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37072024-11-25T19:33:47.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37082024-11-25T19:33:47.136ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 288.416578ms iteration = 6 status = {}
37092024-11-25T19:33:47.139ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37102024-11-25T19:33:47.139ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37112024-11-25T19:33:47.139ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "73ec3ac6-2239-4fda-91de-61dd6bd10f78", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
37122024-11-25T19:33:47.140ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 292.397806ms iteration = 6 status = {}
37132024-11-25T19:33:47.153ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37142024-11-25T19:33:47.155ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37152024-11-25T19:33:47.155ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37162024-11-25T19:33:47.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37172024-11-25T19:33:47.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37182024-11-25T19:33:47.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37192024-11-25T19:33:47.207ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
37202024-11-25T19:33:47.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37212024-11-25T19:33:47.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37222024-11-25T19:33:47.217ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37232024-11-25T19:33:47.217ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "91db0851-588d-4717-af5e-0d6ad5a7489c", "content-length": "134", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
37242024-11-25T19:33:47.217ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37252024-11-25T19:33:47.217ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
37262024-11-25T19:33:47.217ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37272024-11-25T19:33:47.217ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37282024-11-25T19:33:47.217ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37292024-11-25T19:33:47.217ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37302024-11-25T19:33:47.217ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37312024-11-25T19:33:47.217ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37322024-11-25T19:33:47.218ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37332024-11-25T19:33:47.218ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37342024-11-25T19:33:47.218ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
37352024-11-25T19:33:47.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37362024-11-25T19:33:47.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37372024-11-25T19:33:47.220ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37382024-11-25T19:33:47.220ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "82c354ca-32ad-441b-86ee-1e97a4f9105f", "content-length": "2", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
37392024-11-25T19:33:47.220ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37402024-11-25T19:33:47.220ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb45e2dc-d5e8-441d-af5d-d01b5651117d", "content-length": "51", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
37412024-11-25T19:33:47.220ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
37422024-11-25T19:33:47.220ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37432024-11-25T19:33:47.246ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37442024-11-25T19:33:47.324ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "81d72a32-8ce4-46c7-a29e-b0ec82b01597", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
37452024-11-25T19:33:47.324ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
37462024-11-25T19:33:47.324ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37472024-11-25T19:33:47.325ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "88f4b480-4000-4d7e-80d7-6b17fb30ac71", "content-length": "682", "date": "Mon, 25 Nov 2024 19:33:47 GMT"} })
37482024-11-25T19:33:47.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37492024-11-25T19:33:47.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37502024-11-25T19:33:47.325ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad5c75ff-a25c-4bde-9a16-2a0b907dc875", "content-length": "691", "date": "Mon, 25 Nov 2024 19:33:47 GMT"} })
37512024-11-25T19:33:47.325ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
37522024-11-25T19:33:47.326ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
37532024-11-25T19:33:47.326ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
37542024-11-25T19:33:47.327ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 478.965977ms iteration = 6 status = {}
37552024-11-25T19:33:47.329ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37562024-11-25T19:33:47.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37572024-11-25T19:33:47.332ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37582024-11-25T19:33:47.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37592024-11-25T19:33:47.335ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37602024-11-25T19:33:47.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37612024-11-25T19:33:47.341ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 493.544384ms iteration = 6 status = {}
37622024-11-25T19:33:47.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2486cd8b-cdef-4aed-85a8-6ac7afb899da roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37632024-11-25T19:33:47.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2486cd8b-cdef-4aed-85a8-6ac7afb899da resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37642024-11-25T19:33:47.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2486cd8b-cdef-4aed-85a8-6ac7afb899da response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37652024-11-25T19:33:48.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c23ae98d-8f40-4675-ad6f-6063aa7b1e46 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37662024-11-25T19:33:48.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c23ae98d-8f40-4675-ad6f-6063aa7b1e46 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37672024-11-25T19:33:48.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c23ae98d-8f40-4675-ad6f-6063aa7b1e46 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37682024-11-25T19:33:49.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dfb3a442-31c1-4389-ba06-f1cd2a85bb05 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37692024-11-25T19:33:49.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dfb3a442-31c1-4389-ba06-f1cd2a85bb05 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37702024-11-25T19:33:50.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dfb3a442-31c1-4389-ba06-f1cd2a85bb05 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37712024-11-25T19:33:51.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c90d433d-7724-4371-84dd-d000dd309915 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37722024-11-25T19:33:51.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c90d433d-7724-4371-84dd-d000dd309915 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37732024-11-25T19:33:51.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c90d433d-7724-4371-84dd-d000dd309915 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37742024-11-25T19:33:52.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 83a8b5a5-ce65-4b4f-b005-21aa927eabbb roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37752024-11-25T19:33:52.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 83a8b5a5-ce65-4b4f-b005-21aa927eabbb resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37762024-11-25T19:33:52.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 83a8b5a5-ce65-4b4f-b005-21aa927eabbb response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37772024-11-25T19:33:52.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 559 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 5dc63a86-e39e-4740-8591-b041c109021c response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
37782024-11-25T19:33:53.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4eb0e1a3-9a6c-4e28-b0a3-32238ccd89b3 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37792024-11-25T19:33:53.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4eb0e1a3-9a6c-4e28-b0a3-32238ccd89b3 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37802024-11-25T19:33:53.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4eb0e1a3-9a6c-4e28-b0a3-32238ccd89b3 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37812024-11-25T19:33:54.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c7e933cf-8bb4-4764-b951-ffd0c6d42545 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37822024-11-25T19:33:54.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c7e933cf-8bb4-4764-b951-ffd0c6d42545 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37832024-11-25T19:33:54.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c7e933cf-8bb4-4764-b951-ffd0c6d42545 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37842024-11-25T19:33:55.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 057fb44d-bc5f-4a2a-9b41-8439aaa74126 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37852024-11-25T19:33:55.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 057fb44d-bc5f-4a2a-9b41-8439aaa74126 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37862024-11-25T19:33:55.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 057fb44d-bc5f-4a2a-9b41-8439aaa74126 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37872024-11-25T19:33:56.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 546d2b91-f447-46c3-b0da-4208f470324b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37882024-11-25T19:33:56.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 546d2b91-f447-46c3-b0da-4208f470324b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37892024-11-25T19:33:56.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 546d2b91-f447-46c3-b0da-4208f470324b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
37902024-11-25T19:33:56.847ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
37912024-11-25T19:33:56.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37922024-11-25T19:33:56.847ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
37932024-11-25T19:33:56.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37942024-11-25T19:33:56.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37952024-11-25T19:33:56.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37962024-11-25T19:33:56.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37972024-11-25T19:33:56.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37982024-11-25T19:33:56.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.187702ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37992024-11-25T19:33:56.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38002024-11-25T19:33:56.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38012024-11-25T19:33:56.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38022024-11-25T19:33:56.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38032024-11-25T19:33:56.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38042024-11-25T19:33:56.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38052024-11-25T19:33:56.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38062024-11-25T19:33:56.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
38072024-11-25T19:33:56.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38082024-11-25T19:33:56.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38092024-11-25T19:33:56.903ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
38102024-11-25T19:33:56.903ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.512309ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
38112024-11-25T19:33:57.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3f0e86f4-fedd-4fc9-bdf3-7711f23f60af roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38122024-11-25T19:33:57.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3f0e86f4-fedd-4fc9-bdf3-7711f23f60af resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38132024-11-25T19:33:57.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3f0e86f4-fedd-4fc9-bdf3-7711f23f60af response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38142024-11-25T19:33:58.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 63fdb784-fd71-4d2b-962c-75bb72d825d4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38152024-11-25T19:33:58.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 63fdb784-fd71-4d2b-962c-75bb72d825d4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38162024-11-25T19:33:58.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1859 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 63fdb784-fd71-4d2b-962c-75bb72d825d4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38172024-11-25T19:33:59.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1825218f-eb69-402f-b623-efa0f26eee4d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38182024-11-25T19:33:59.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1825218f-eb69-402f-b623-efa0f26eee4d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38192024-11-25T19:33:59.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1825218f-eb69-402f-b623-efa0f26eee4d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38202024-11-25T19:34:00.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3f7373ab-6c5c-4c8f-909e-0c4d10208a08 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38212024-11-25T19:34:00.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3f7373ab-6c5c-4c8f-909e-0c4d10208a08 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38222024-11-25T19:34:00.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3f7373ab-6c5c-4c8f-909e-0c4d10208a08 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38232024-11-25T19:34:01.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9b7965bc-9d01-467e-ba37-7e5a79379e43 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38242024-11-25T19:34:01.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9b7965bc-9d01-467e-ba37-7e5a79379e43 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38252024-11-25T19:34:01.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9b7965bc-9d01-467e-ba37-7e5a79379e43 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38262024-11-25T19:34:02.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 74e85ac0-dc73-4fa5-abd4-26c4bb2ab411 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38272024-11-25T19:34:02.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 74e85ac0-dc73-4fa5-abd4-26c4bb2ab411 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38282024-11-25T19:34:02.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 74e85ac0-dc73-4fa5-abd4-26c4bb2ab411 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38292024-11-25T19:34:02.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 819 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 5f1ae0d2-3a4c-4006-b9b7-5e9a7712de6b response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
38302024-11-25T19:34:03.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 11febeb8-2e2c-4ae1-9683-d63649abd3aa roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38312024-11-25T19:34:03.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 11febeb8-2e2c-4ae1-9683-d63649abd3aa resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38322024-11-25T19:34:03.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 11febeb8-2e2c-4ae1-9683-d63649abd3aa response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38332024-11-25T19:34:04.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9a877a5c-f6ab-41d5-96e3-696efc637727 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38342024-11-25T19:34:04.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9a877a5c-f6ab-41d5-96e3-696efc637727 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38352024-11-25T19:34:04.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9a877a5c-f6ab-41d5-96e3-696efc637727 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38362024-11-25T19:34:05.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aaa924ac-aec0-49bf-ab7a-107a1183c452 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38372024-11-25T19:34:05.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aaa924ac-aec0-49bf-ab7a-107a1183c452 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38382024-11-25T19:34:05.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aaa924ac-aec0-49bf-ab7a-107a1183c452 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38392024-11-25T19:34:06.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d872a65b-7068-4de8-83ff-ae0e969bb83a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38402024-11-25T19:34:06.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d872a65b-7068-4de8-83ff-ae0e969bb83a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38412024-11-25T19:34:06.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d872a65b-7068-4de8-83ff-ae0e969bb83a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38422024-11-25T19:34:06.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
38432024-11-25T19:34:06.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
38442024-11-25T19:34:06.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38452024-11-25T19:34:06.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38462024-11-25T19:34:06.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38472024-11-25T19:34:06.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38482024-11-25T19:34:06.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38492024-11-25T19:34:06.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38502024-11-25T19:34:06.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38512024-11-25T19:34:06.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38522024-11-25T19:34:06.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38532024-11-25T19:34:06.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38542024-11-25T19:34:06.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38552024-11-25T19:34:06.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
38562024-11-25T19:34:06.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38572024-11-25T19:34:06.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38582024-11-25T19:34:06.868ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
38592024-11-25T19:34:06.868ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.549984ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
38602024-11-25T19:34:06.877ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38612024-11-25T19:34:06.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38622024-11-25T19:34:06.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.429057ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38632024-11-25T19:34:07.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = c224eaea-d6ea-4768-89d9-2f41e3db7a4a roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
38642024-11-25T19:34:07.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = c224eaea-d6ea-4768-89d9-2f41e3db7a4a resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
38652024-11-25T19:34:07.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = c224eaea-d6ea-4768-89d9-2f41e3db7a4a response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
38662024-11-25T19:34:07.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = f336cb2a-b909-4694-861c-58c266e934d5 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
38672024-11-25T19:34:07.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = f336cb2a-b909-4694-861c-58c266e934d5 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
38682024-11-25T19:34:07.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45112 req_id = f336cb2a-b909-4694-861c-58c266e934d5 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
38692024-11-25T19:34:07.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 11838037-298e-416f-b23d-d7511879a3b0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38702024-11-25T19:34:07.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 11838037-298e-416f-b23d-d7511879a3b0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38712024-11-25T19:34:07.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 11838037-298e-416f-b23d-d7511879a3b0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38722024-11-25T19:34:08.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a843c047-c8af-4660-894a-0794e3a6dfa2 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38732024-11-25T19:34:08.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a843c047-c8af-4660-894a-0794e3a6dfa2 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38742024-11-25T19:34:08.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a843c047-c8af-4660-894a-0794e3a6dfa2 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38752024-11-25T19:34:09.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b5eb53e0-d3ed-4ec4-98d1-5f75cfbd0a1f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38762024-11-25T19:34:09.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b5eb53e0-d3ed-4ec4-98d1-5f75cfbd0a1f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38772024-11-25T19:34:09.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b5eb53e0-d3ed-4ec4-98d1-5f75cfbd0a1f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38782024-11-25T19:34:10.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e473d0f0-36b3-414e-8f56-79993a4d7e5e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38792024-11-25T19:34:10.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e473d0f0-36b3-414e-8f56-79993a4d7e5e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38802024-11-25T19:34:10.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e473d0f0-36b3-414e-8f56-79993a4d7e5e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38812024-11-25T19:34:11.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a882402d-b8ba-48da-9913-7d5daa58da54 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38822024-11-25T19:34:11.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a882402d-b8ba-48da-9913-7d5daa58da54 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38832024-11-25T19:34:11.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a882402d-b8ba-48da-9913-7d5daa58da54 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38842024-11-25T19:34:12.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 495 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = b3a85b5a-c1d8-4536-a7be-a4f5280966ae response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
38852024-11-25T19:34:12.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1db02269-f316-4e92-8455-92c74e69e83a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38862024-11-25T19:34:12.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1db02269-f316-4e92-8455-92c74e69e83a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38872024-11-25T19:34:12.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1db02269-f316-4e92-8455-92c74e69e83a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38882024-11-25T19:34:13.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5af7e30d-c7fa-4936-8e81-382e05f29cb0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38892024-11-25T19:34:13.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5af7e30d-c7fa-4936-8e81-382e05f29cb0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38902024-11-25T19:34:13.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5af7e30d-c7fa-4936-8e81-382e05f29cb0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38912024-11-25T19:34:14.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a33e8335-89ed-430e-bac4-c9c4fb67f05e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38922024-11-25T19:34:14.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a33e8335-89ed-430e-bac4-c9c4fb67f05e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38932024-11-25T19:34:14.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a33e8335-89ed-430e-bac4-c9c4fb67f05e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38942024-11-25T19:34:15.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ce66ff2d-eea7-4785-934a-73ea4a6def0a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38952024-11-25T19:34:15.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ce66ff2d-eea7-4785-934a-73ea4a6def0a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38962024-11-25T19:34:15.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ce66ff2d-eea7-4785-934a-73ea4a6def0a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38972024-11-25T19:34:16.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1454f6c5-ca2b-495c-973a-715889049867 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38982024-11-25T19:34:16.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1454f6c5-ca2b-495c-973a-715889049867 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
38992024-11-25T19:34:16.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1454f6c5-ca2b-495c-973a-715889049867 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
39002024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
39012024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39022024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
39032024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
39042024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39052024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
39062024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39072024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
39082024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39092024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39102024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
39112024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
39122024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
39132024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
39142024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
39152024-11-25T19:34:16.848ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
39162024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
39172024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
39182024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39192024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39202024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
39212024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
39222024-11-25T19:34:16.848ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
39232024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39242024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
39252024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.64\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
39262024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
39272024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39282024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39292024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
39302024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
39312024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39322024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
39332024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39342024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
39352024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
39362024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39372024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
39382024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39392024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39402024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
39412024-11-25T19:34:16.848ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39422024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39432024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
39442024-11-25T19:34:16.848ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:24:16.848650981 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
39452024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
39462024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
39472024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39482024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39492024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
39502024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
39512024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
39522024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
39532024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
39542024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
39552024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
39562024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39572024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
39582024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
39592024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39602024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
39612024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39622024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
39632024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39642024-11-25T19:34:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39652024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39662024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39672024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39682024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39692024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39702024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39712024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39722024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
39732024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39742024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39752024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39762024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39772024-11-25T19:34:16.849ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1282, tv_nsec: 395661289 } })
39782024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39792024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39802024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39812024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39822024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39832024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
39842024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
39852024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39862024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39872024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
39882024-11-25T19:34:16.849ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1282, tv_nsec: 395800382 } })
39892024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39902024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39912024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39922024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39932024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39942024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39952024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39962024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39972024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39982024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
39992024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.078301ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
40002024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
40012024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.392518ms iteration = 4 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
40022024-11-25T19:34:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40032024-11-25T19:34:16.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40042024-11-25T19:34:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40052024-11-25T19:34:16.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40062024-11-25T19:34:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40072024-11-25T19:34:16.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40082024-11-25T19:34:16.852ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1282, tv_nsec: 398634767 } })
40092024-11-25T19:34:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.780145ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40102024-11-25T19:34:16.852ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
40112024-11-25T19:34:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40122024-11-25T19:34:16.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40132024-11-25T19:34:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40142024-11-25T19:34:16.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40152024-11-25T19:34:16.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40162024-11-25T19:34:16.857ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1282, tv_nsec: 404263438 } })
40172024-11-25T19:34:16.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40182024-11-25T19:34:16.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40192024-11-25T19:34:16.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40202024-11-25T19:34:16.858ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
40212024-11-25T19:34:16.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40222024-11-25T19:34:16.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40232024-11-25T19:34:16.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40242024-11-25T19:34:16.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40252024-11-25T19:34:16.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40262024-11-25T19:34:16.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.043167ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
40272024-11-25T19:34:16.862ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:24:16.848650981 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
40282024-11-25T19:34:16.862ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.623628ms iteration = 4 status = {"expiration":"2024-11-25T19:24:16.848650981Z","pruned":[]}
40292024-11-25T19:34:16.863ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.062316ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
40302024-11-25T19:34:16.868ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40312024-11-25T19:34:16.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40322024-11-25T19:34:16.870ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40332024-11-25T19:34:16.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40342024-11-25T19:34:16.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 24.48404ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40352024-11-25T19:34:16.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40362024-11-25T19:34:16.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40372024-11-25T19:34:16.881ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
40382024-11-25T19:34:16.881ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
40392024-11-25T19:34:16.881ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
40402024-11-25T19:34:16.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40412024-11-25T19:34:16.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40422024-11-25T19:34:16.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40432024-11-25T19:34:16.886ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40442024-11-25T19:34:16.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40452024-11-25T19:34:16.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40462024-11-25T19:34:16.894ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1282, tv_nsec: 440779754 } })
40472024-11-25T19:34:16.894ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
40482024-11-25T19:34:16.895ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40492024-11-25T19:34:16.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40502024-11-25T19:34:16.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40512024-11-25T19:34:16.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40522024-11-25T19:34:16.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
40532024-11-25T19:34:16.898ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40542024-11-25T19:34:16.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40552024-11-25T19:34:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40562024-11-25T19:34:16.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 52.611652ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40572024-11-25T19:34:16.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40582024-11-25T19:34:16.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40592024-11-25T19:34:16.903ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40602024-11-25T19:34:16.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40612024-11-25T19:34:16.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40622024-11-25T19:34:16.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40632024-11-25T19:34:16.906ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40642024-11-25T19:34:16.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40652024-11-25T19:34:16.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40662024-11-25T19:34:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40672024-11-25T19:34:16.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40682024-11-25T19:34:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40692024-11-25T19:34:16.908ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40702024-11-25T19:34:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40712024-11-25T19:34:16.911ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40722024-11-25T19:34:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40732024-11-25T19:34:16.912ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40742024-11-25T19:34:16.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.291231ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
40752024-11-25T19:34:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40762024-11-25T19:34:16.914ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40772024-11-25T19:34:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40782024-11-25T19:34:16.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40792024-11-25T19:34:16.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40802024-11-25T19:34:16.918ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40812024-11-25T19:34:16.918ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40822024-11-25T19:34:16.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40832024-11-25T19:34:16.918ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40842024-11-25T19:34:16.918ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40852024-11-25T19:34:16.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40862024-11-25T19:34:16.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40872024-11-25T19:34:16.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40882024-11-25T19:34:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40892024-11-25T19:34:16.921ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40902024-11-25T19:34:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40912024-11-25T19:34:16.921ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40922024-11-25T19:34:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40932024-11-25T19:34:16.922ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40942024-11-25T19:34:16.923ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40952024-11-25T19:34:16.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40962024-11-25T19:34:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40972024-11-25T19:34:16.923ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40982024-11-25T19:34:16.924ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40992024-11-25T19:34:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41002024-11-25T19:34:16.924ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41012024-11-25T19:34:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41022024-11-25T19:34:16.926ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
41032024-11-25T19:34:16.926ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
41042024-11-25T19:34:16.926ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 77.719995ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
41052024-11-25T19:34:16.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
41062024-11-25T19:34:16.926ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41072024-11-25T19:34:16.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41082024-11-25T19:34:16.927ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41092024-11-25T19:34:16.927ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41102024-11-25T19:34:16.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41112024-11-25T19:34:16.928ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41122024-11-25T19:34:16.928ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
41132024-11-25T19:34:16.928ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41142024-11-25T19:34:16.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41152024-11-25T19:34:16.929ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 81.098631ms iteration = 3 status = {"nsuccess":5}
41162024-11-25T19:34:16.931ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41172024-11-25T19:34:16.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41182024-11-25T19:34:16.940ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41192024-11-25T19:34:16.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41202024-11-25T19:34:16.941ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41212024-11-25T19:34:16.941ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41222024-11-25T19:34:16.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41232024-11-25T19:34:16.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
41242024-11-25T19:34:16.944ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41252024-11-25T19:34:16.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41262024-11-25T19:34:16.948ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
41272024-11-25T19:34:16.948ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
41282024-11-25T19:34:16.948ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
41292024-11-25T19:34:16.948ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41302024-11-25T19:34:16.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41312024-11-25T19:34:16.953ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
41322024-11-25T19:34:16.953ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
41332024-11-25T19:34:16.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41342024-11-25T19:34:16.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41352024-11-25T19:34:16.955ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
41362024-11-25T19:34:16.955ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
41372024-11-25T19:34:16.955ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 107.206214ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
41382024-11-25T19:34:16.955ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41392024-11-25T19:34:16.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41402024-11-25T19:34:16.964ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 115.440554ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
41412024-11-25T19:34:16.964ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
41422024-11-25T19:34:16.964ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 115.666939ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41432024-11-25T19:34:16.983ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41442024-11-25T19:34:16.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41452024-11-25T19:34:17.017ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 168.862553ms iteration = 9 status = {"physical_disks_added":0}
41462024-11-25T19:34:17.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 538676ff-ccf7-423f-8083-fd2115bf99a9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
41472024-11-25T19:34:17.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 538676ff-ccf7-423f-8083-fd2115bf99a9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
41482024-11-25T19:34:17.021ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
41492024-11-25T19:34:17.021ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41502024-11-25T19:34:17.021ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83305f39-1906-4d06-8004-7ed93b2b7d23", "content-length": "26", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
41512024-11-25T19:34:17.021ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41522024-11-25T19:34:17.023ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41532024-11-25T19:34:17.029ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
41542024-11-25T19:34:17.029ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41552024-11-25T19:34:17.030ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfd6993f-1775-49e3-8c16-06ee3a5ae4f7", "content-length": "26", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
41562024-11-25T19:34:17.030ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41572024-11-25T19:34:17.031ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41582024-11-25T19:34:17.147ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
41592024-11-25T19:34:17.179ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
41602024-11-25T19:34:17.196ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
41612024-11-25T19:34:17.196ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41622024-11-25T19:34:17.196ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "27bf1a02-4855-4237-b834-790461ea55cb", "content-length": "26", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
41632024-11-25T19:34:17.196ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41642024-11-25T19:34:17.198ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
41652024-11-25T19:34:17.234ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41662024-11-25T19:34:17.234ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41672024-11-25T19:34:17.235ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd8c7599-ff7c-4c49-a8a8-2069127ee50e", "content-length": "372", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
41682024-11-25T19:34:17.235ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41692024-11-25T19:34:17.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41702024-11-25T19:34:17.237ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41712024-11-25T19:34:17.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41722024-11-25T19:34:17.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41732024-11-25T19:34:17.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
41742024-11-25T19:34:17.240ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41752024-11-25T19:34:17.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41762024-11-25T19:34:17.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41772024-11-25T19:34:17.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41782024-11-25T19:34:17.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41792024-11-25T19:34:17.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41802024-11-25T19:34:17.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41812024-11-25T19:34:17.250ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
41822024-11-25T19:34:17.250ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 402.075079ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
41832024-11-25T19:34:17.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 538676ff-ccf7-423f-8083-fd2115bf99a9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
41842024-11-25T19:34:17.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
41852024-11-25T19:34:17.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41862024-11-25T19:34:17.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41872024-11-25T19:34:17.259ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 410.997864ms iteration = 7 status = 0
41882024-11-25T19:34:17.279ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41892024-11-25T19:34:17.279ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41902024-11-25T19:34:17.279ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41912024-11-25T19:34:17.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41922024-11-25T19:34:17.283ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
41932024-11-25T19:34:17.283ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
41942024-11-25T19:34:17.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41952024-11-25T19:34:17.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41962024-11-25T19:34:17.285ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 436.552305ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
41972024-11-25T19:34:17.287ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41982024-11-25T19:34:17.290ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41992024-11-25T19:34:17.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42002024-11-25T19:34:17.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42012024-11-25T19:34:17.291ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42022024-11-25T19:34:17.291ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42032024-11-25T19:34:17.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42042024-11-25T19:34:17.294ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
42052024-11-25T19:34:17.294ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
42062024-11-25T19:34:17.294ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
42072024-11-25T19:34:17.294ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 445.651444ms iteration = 4 status = {"generation":2}
42082024-11-25T19:34:17.295ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
42092024-11-25T19:34:17.295ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42102024-11-25T19:34:17.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42112024-11-25T19:34:17.302ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
42122024-11-25T19:34:17.302ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
42132024-11-25T19:34:17.302ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0ba029d3-9c5d-4976-8f19-2ef1fa69efcf", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
42142024-11-25T19:34:17.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42152024-11-25T19:34:17.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42162024-11-25T19:34:17.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42172024-11-25T19:34:17.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42182024-11-25T19:34:17.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42192024-11-25T19:34:17.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42202024-11-25T19:34:17.309ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
42212024-11-25T19:34:17.309ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 460.838241ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
42222024-11-25T19:34:17.312ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
42232024-11-25T19:34:17.312ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42242024-11-25T19:34:17.312ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42252024-11-25T19:34:17.312ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
42262024-11-25T19:34:17.312ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 464.114816ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
42272024-11-25T19:34:17.313ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "848cd80b-fb08-4328-9c66-b61ac8f2f408", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
42282024-11-25T19:34:17.314ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 465.748248ms iteration = 7 status = {}
42292024-11-25T19:34:17.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42302024-11-25T19:34:17.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42312024-11-25T19:34:17.318ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42322024-11-25T19:34:17.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42332024-11-25T19:34:17.321ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
42342024-11-25T19:34:17.321ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
42352024-11-25T19:34:17.321ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
42362024-11-25T19:34:17.321ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 472.872717ms iteration = 4 status = {"generation":1}
42372024-11-25T19:34:17.331ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
42382024-11-25T19:34:17.331ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 482.394905ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
42392024-11-25T19:34:17.336ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 488.543606ms iteration = 7 status = {}
42402024-11-25T19:34:17.344ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42412024-11-25T19:34:17.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42422024-11-25T19:34:17.346ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42432024-11-25T19:34:17.346ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
42442024-11-25T19:34:17.346ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bfafee3-e647-4e54-b584-4c79fcb88eb6", "content-length": "1", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
42452024-11-25T19:34:17.348ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42462024-11-25T19:34:17.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42472024-11-25T19:34:17.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42482024-11-25T19:34:17.348ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42492024-11-25T19:34:17.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42502024-11-25T19:34:17.351ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 502.434718ms iteration = 7 status = null
42512024-11-25T19:34:17.383ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42522024-11-25T19:34:17.385ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42532024-11-25T19:34:17.385ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42542024-11-25T19:34:17.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42552024-11-25T19:34:17.412ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
42562024-11-25T19:34:17.412ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6d2fe1c0-e4a3-43c0-9c82-be8809672662", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42572024-11-25T19:34:17.412ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42582024-11-25T19:34:17.414ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d4899aa5-92a2-4fbf-b032-c9ad5ef4601a", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42592024-11-25T19:34:17.414ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42602024-11-25T19:34:17.415ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42612024-11-25T19:34:17.415ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 567.153147ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
42622024-11-25T19:34:17.427ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
42632024-11-25T19:34:17.525ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42642024-11-25T19:34:17.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42652024-11-25T19:34:17.527ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
42662024-11-25T19:34:17.527ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42672024-11-25T19:34:17.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42682024-11-25T19:34:17.537ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42692024-11-25T19:34:17.537ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e87ec7a-2847-49a9-8b5b-13ee6bea790c", "content-length": "134", "date": "Mon, 25 Nov 2024 19:34:17 GMT"} })
42702024-11-25T19:34:17.537ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
42712024-11-25T19:34:17.537ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
42722024-11-25T19:34:17.537ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
42732024-11-25T19:34:17.537ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42742024-11-25T19:34:17.537ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42752024-11-25T19:34:17.537ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42762024-11-25T19:34:17.537ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42772024-11-25T19:34:17.537ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42782024-11-25T19:34:17.537ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42792024-11-25T19:34:17.537ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42802024-11-25T19:34:17.537ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
42812024-11-25T19:34:17.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42822024-11-25T19:34:17.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42832024-11-25T19:34:17.540ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42842024-11-25T19:34:17.540ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "052e5ccd-e2a3-4ea2-b333-26f153f557d1", "content-length": "2", "date": "Mon, 25 Nov 2024 19:34:17 GMT"} })
42852024-11-25T19:34:17.540ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42862024-11-25T19:34:17.540ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a86fc558-3ffa-40a6-b05e-462ebb8ad05f", "content-length": "51", "date": "Mon, 25 Nov 2024 19:34:17 GMT"} })
42872024-11-25T19:34:17.540ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
42882024-11-25T19:34:17.540ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42892024-11-25T19:34:17.561ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
42902024-11-25T19:34:17.562ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4d035de4-04da-4664-85a8-dfead75c9894", "date": "Mon, 25 Nov 2024 19:34:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42912024-11-25T19:34:17.562ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42922024-11-25T19:34:17.563ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "260ec0a3-a358-451f-9e27-14c0a680a0f6", "date": "Mon, 25 Nov 2024 19:34:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42932024-11-25T19:34:17.563ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42942024-11-25T19:34:17.564ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8acbc689-c5e9-4fad-b056-c153168e4319", "date": "Mon, 25 Nov 2024 19:34:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42952024-11-25T19:34:17.564ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42962024-11-25T19:34:17.566ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42972024-11-25T19:34:17.566ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 717.694611ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
42982024-11-25T19:34:17.571ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42992024-11-25T19:34:17.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = daebf825-2fae-4f53-af2a-9fbb1df16b37 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43002024-11-25T19:34:17.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = daebf825-2fae-4f53-af2a-9fbb1df16b37 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43012024-11-25T19:34:17.604ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d01c8263-7b0b-4e9e-b80a-282715178424", "content-length": "691", "date": "Mon, 25 Nov 2024 19:34:17 GMT"} })
43022024-11-25T19:34:17.604ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
43032024-11-25T19:34:17.604ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
43042024-11-25T19:34:17.604ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
43052024-11-25T19:34:17.605ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 756.89647ms iteration = 7 status = {}
43062024-11-25T19:34:17.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = daebf825-2fae-4f53-af2a-9fbb1df16b37 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43072024-11-25T19:34:17.693ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ce4d14e9-50b9-496f-a80f-a8678503d3b7", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
43082024-11-25T19:34:17.693ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
43092024-11-25T19:34:17.693ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43102024-11-25T19:34:17.693ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a91602e4-ffb9-4085-8c2e-0cd5cd36e86a", "content-length": "682", "date": "Mon, 25 Nov 2024 19:34:17 GMT"} })
43112024-11-25T19:34:17.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43122024-11-25T19:34:17.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43132024-11-25T19:34:17.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43142024-11-25T19:34:17.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43152024-11-25T19:34:17.701ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43162024-11-25T19:34:17.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43172024-11-25T19:34:17.703ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43182024-11-25T19:34:17.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43192024-11-25T19:34:17.709ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 861.233928ms iteration = 7 status = {}
43202024-11-25T19:34:18.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b9dcad79-5965-458c-90b9-5f36e6f40246 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43212024-11-25T19:34:18.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b9dcad79-5965-458c-90b9-5f36e6f40246 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43222024-11-25T19:34:18.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b9dcad79-5965-458c-90b9-5f36e6f40246 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43232024-11-25T19:34:19.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9b3988e9-115a-4d62-931d-879dc2d296d1 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43242024-11-25T19:34:19.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9b3988e9-115a-4d62-931d-879dc2d296d1 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43252024-11-25T19:34:19.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9b3988e9-115a-4d62-931d-879dc2d296d1 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43262024-11-25T19:34:20.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 81cf7c7c-0406-48c6-8975-30b1f83552ca roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43272024-11-25T19:34:20.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 81cf7c7c-0406-48c6-8975-30b1f83552ca resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43282024-11-25T19:34:20.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 81cf7c7c-0406-48c6-8975-30b1f83552ca response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43292024-11-25T19:34:21.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = abd48393-d6b3-42dd-af8d-dbc7218174a3 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43302024-11-25T19:34:21.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = abd48393-d6b3-42dd-af8d-dbc7218174a3 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43312024-11-25T19:34:21.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = abd48393-d6b3-42dd-af8d-dbc7218174a3 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43322024-11-25T19:34:22.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 506 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = c386e78b-7da0-406a-bdcc-644ddb914449 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
43332024-11-25T19:34:22.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3f64b831-9813-4b2d-9e96-b68fc49e39bf roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43342024-11-25T19:34:22.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3f64b831-9813-4b2d-9e96-b68fc49e39bf resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43352024-11-25T19:34:22.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3f64b831-9813-4b2d-9e96-b68fc49e39bf response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43362024-11-25T19:34:23.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a082ec51-b1f2-4371-9d99-26328e0d587a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43372024-11-25T19:34:23.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a082ec51-b1f2-4371-9d99-26328e0d587a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43382024-11-25T19:34:23.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a082ec51-b1f2-4371-9d99-26328e0d587a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43392024-11-25T19:34:24.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 50373ac7-c46d-484e-8fe5-cf26ef54fa1c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43402024-11-25T19:34:24.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 50373ac7-c46d-484e-8fe5-cf26ef54fa1c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43412024-11-25T19:34:24.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 50373ac7-c46d-484e-8fe5-cf26ef54fa1c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43422024-11-25T19:34:25.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0340f386-ee90-4341-bb09-26be0253c4a3 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43432024-11-25T19:34:25.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0340f386-ee90-4341-bb09-26be0253c4a3 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43442024-11-25T19:34:25.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0340f386-ee90-4341-bb09-26be0253c4a3 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43452024-11-25T19:34:26.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1f4f9e86-61c5-41bc-8045-a3b44fae1275 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43462024-11-25T19:34:26.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1f4f9e86-61c5-41bc-8045-a3b44fae1275 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43472024-11-25T19:34:26.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1f4f9e86-61c5-41bc-8045-a3b44fae1275 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43482024-11-25T19:34:26.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
43492024-11-25T19:34:26.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
43502024-11-25T19:34:26.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43512024-11-25T19:34:26.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43522024-11-25T19:34:26.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43532024-11-25T19:34:26.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43542024-11-25T19:34:26.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43552024-11-25T19:34:26.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43562024-11-25T19:34:26.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43572024-11-25T19:34:26.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43582024-11-25T19:34:26.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43592024-11-25T19:34:26.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43602024-11-25T19:34:26.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43612024-11-25T19:34:26.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43622024-11-25T19:34:26.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43632024-11-25T19:34:26.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
43642024-11-25T19:34:26.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43652024-11-25T19:34:26.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43662024-11-25T19:34:26.868ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
43672024-11-25T19:34:26.868ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.786848ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
43682024-11-25T19:34:26.884ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.491216ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43692024-11-25T19:34:27.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 010c35da-0d0c-4d27-9cd2-0289801398f1 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43702024-11-25T19:34:27.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 010c35da-0d0c-4d27-9cd2-0289801398f1 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43712024-11-25T19:34:27.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 010c35da-0d0c-4d27-9cd2-0289801398f1 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43722024-11-25T19:34:28.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e6c74e21-6ead-4ab2-b1b0-46d21673cd8f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43732024-11-25T19:34:28.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e6c74e21-6ead-4ab2-b1b0-46d21673cd8f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43742024-11-25T19:34:28.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e6c74e21-6ead-4ab2-b1b0-46d21673cd8f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43752024-11-25T19:34:29.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 494095e1-764d-4977-b009-d2fd560d18aa roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43762024-11-25T19:34:29.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 494095e1-764d-4977-b009-d2fd560d18aa resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43772024-11-25T19:34:29.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 494095e1-764d-4977-b009-d2fd560d18aa response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43782024-11-25T19:34:30.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 350eee21-48a3-4eaf-bf29-662e960a94e4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43792024-11-25T19:34:30.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 350eee21-48a3-4eaf-bf29-662e960a94e4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43802024-11-25T19:34:30.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 350eee21-48a3-4eaf-bf29-662e960a94e4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43812024-11-25T19:34:31.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 77c3eedd-79ee-45d1-8777-570d3c728093 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43822024-11-25T19:34:31.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 77c3eedd-79ee-45d1-8777-570d3c728093 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43832024-11-25T19:34:31.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 77c3eedd-79ee-45d1-8777-570d3c728093 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43842024-11-25T19:34:32.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 811 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 970de6c5-1f00-41ca-8ab2-921c7e0e17ab response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
43852024-11-25T19:34:32.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6c5c4031-2ba8-475b-a52b-6c239d9162a0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43862024-11-25T19:34:32.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6c5c4031-2ba8-475b-a52b-6c239d9162a0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43872024-11-25T19:34:32.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6c5c4031-2ba8-475b-a52b-6c239d9162a0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43882024-11-25T19:34:33.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ba11852c-908f-41a0-891b-f813a7cffb36 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43892024-11-25T19:34:33.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ba11852c-908f-41a0-891b-f813a7cffb36 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43902024-11-25T19:34:33.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ba11852c-908f-41a0-891b-f813a7cffb36 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43912024-11-25T19:34:34.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0651c3cf-a4d3-4971-8556-30aee75f8ddf roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43922024-11-25T19:34:34.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0651c3cf-a4d3-4971-8556-30aee75f8ddf resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43932024-11-25T19:34:34.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0651c3cf-a4d3-4971-8556-30aee75f8ddf response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43942024-11-25T19:34:35.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5688d088-b525-4a59-8760-6667f2e9f1f1 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43952024-11-25T19:34:35.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5688d088-b525-4a59-8760-6667f2e9f1f1 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43962024-11-25T19:34:35.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5688d088-b525-4a59-8760-6667f2e9f1f1 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
43972024-11-25T19:34:36.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
43982024-11-25T19:34:36.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43992024-11-25T19:34:36.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
44002024-11-25T19:34:36.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44012024-11-25T19:34:36.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44022024-11-25T19:34:36.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44032024-11-25T19:34:36.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44042024-11-25T19:34:36.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44052024-11-25T19:34:36.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44062024-11-25T19:34:36.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44072024-11-25T19:34:36.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44082024-11-25T19:34:36.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44092024-11-25T19:34:36.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44102024-11-25T19:34:36.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44112024-11-25T19:34:36.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44122024-11-25T19:34:36.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
44132024-11-25T19:34:36.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44142024-11-25T19:34:36.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44152024-11-25T19:34:36.901ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
44162024-11-25T19:34:36.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.984509ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
44172024-11-25T19:34:36.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.755963ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44182024-11-25T19:34:37.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 807d3eee-8895-4cbf-b384-13168333ac99 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44192024-11-25T19:34:37.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 807d3eee-8895-4cbf-b384-13168333ac99 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44202024-11-25T19:34:37.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 807d3eee-8895-4cbf-b384-13168333ac99 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44212024-11-25T19:34:38.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 569de33b-59c4-48fd-be83-6d1f8584674b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44222024-11-25T19:34:38.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 569de33b-59c4-48fd-be83-6d1f8584674b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44232024-11-25T19:34:38.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 569de33b-59c4-48fd-be83-6d1f8584674b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44242024-11-25T19:34:39.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 729449c6-efd6-4845-b989-8545a5524fa2 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44252024-11-25T19:34:39.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 729449c6-efd6-4845-b989-8545a5524fa2 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44262024-11-25T19:34:39.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1645 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 729449c6-efd6-4845-b989-8545a5524fa2 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44272024-11-25T19:34:40.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6c3516e4-0430-431e-a55d-dbaf33df717e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44282024-11-25T19:34:40.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6c3516e4-0430-431e-a55d-dbaf33df717e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44292024-11-25T19:34:40.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6c3516e4-0430-431e-a55d-dbaf33df717e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44302024-11-25T19:34:41.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 34093ee0-ddc2-4e8c-9496-3b5289609ceb roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44312024-11-25T19:34:41.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 34093ee0-ddc2-4e8c-9496-3b5289609ceb resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44322024-11-25T19:34:41.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 34093ee0-ddc2-4e8c-9496-3b5289609ceb response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44332024-11-25T19:34:42.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = edabe5e7-5f87-483d-9290-73e85db07bd9 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44342024-11-25T19:34:42.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = edabe5e7-5f87-483d-9290-73e85db07bd9 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44352024-11-25T19:34:42.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = edabe5e7-5f87-483d-9290-73e85db07bd9 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44362024-11-25T19:34:42.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 544 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = a9ecc6dd-cefb-439e-8f69-bdf3f59fc44d response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
44372024-11-25T19:34:43.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bdcce7cc-b27f-4440-a983-2f9b13b16fc2 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44382024-11-25T19:34:43.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bdcce7cc-b27f-4440-a983-2f9b13b16fc2 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44392024-11-25T19:34:43.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2630 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bdcce7cc-b27f-4440-a983-2f9b13b16fc2 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44402024-11-25T19:34:44.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2d40fb9c-7e6d-4a2c-b12b-c5dfb09f719f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44412024-11-25T19:34:44.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2d40fb9c-7e6d-4a2c-b12b-c5dfb09f719f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44422024-11-25T19:34:44.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2d40fb9c-7e6d-4a2c-b12b-c5dfb09f719f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44432024-11-25T19:34:45.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dd50c837-1467-44a1-ba4f-c016d678e948 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44442024-11-25T19:34:45.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dd50c837-1467-44a1-ba4f-c016d678e948 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44452024-11-25T19:34:45.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dd50c837-1467-44a1-ba4f-c016d678e948 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44462024-11-25T19:34:46.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a67c768f-06f8-4fa1-a9ec-a567b2e35aab roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44472024-11-25T19:34:46.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a67c768f-06f8-4fa1-a9ec-a567b2e35aab resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44482024-11-25T19:34:46.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a67c768f-06f8-4fa1-a9ec-a567b2e35aab response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
44492024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
44502024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
44512024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
44522024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44532024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
44542024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
44552024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44562024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
44572024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
44582024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44592024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44602024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
44612024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
44622024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44632024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
44642024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
44652024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44662024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
44672024-11-25T19:34:46.848ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
44682024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44692024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44702024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
44712024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
44722024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44732024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44742024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
44752024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
44762024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
44772024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
44782024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44792024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44802024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
44812024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44822024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
44832024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44842024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
44852024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44862024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44872024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44882024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44892024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44902024-11-25T19:34:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44912024-11-25T19:34:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
44922024-11-25T19:34:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44932024-11-25T19:34:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44942024-11-25T19:34:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44952024-11-25T19:34:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44962024-11-25T19:34:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44972024-11-25T19:34:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44982024-11-25T19:34:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44992024-11-25T19:34:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45002024-11-25T19:34:46.850ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.550931ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
45012024-11-25T19:34:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45022024-11-25T19:34:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45032024-11-25T19:34:46.851ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1312, tv_nsec: 397688909 } })
45042024-11-25T19:34:46.851ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
45052024-11-25T19:34:46.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45062024-11-25T19:34:46.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45072024-11-25T19:34:46.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45082024-11-25T19:34:46.852ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45092024-11-25T19:34:46.852ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
45102024-11-25T19:34:46.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45112024-11-25T19:34:46.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45122024-11-25T19:34:46.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
45132024-11-25T19:34:46.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45142024-11-25T19:34:46.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45152024-11-25T19:34:46.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45162024-11-25T19:34:46.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45172024-11-25T19:34:46.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45182024-11-25T19:34:46.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45192024-11-25T19:34:46.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45202024-11-25T19:34:46.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45212024-11-25T19:34:46.857ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45222024-11-25T19:34:46.857ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1312, tv_nsec: 403425911 } })
45232024-11-25T19:34:46.857ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
45242024-11-25T19:34:46.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45252024-11-25T19:34:46.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45262024-11-25T19:34:46.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45272024-11-25T19:34:46.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45282024-11-25T19:34:46.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45292024-11-25T19:34:46.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45302024-11-25T19:34:46.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45312024-11-25T19:34:46.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45322024-11-25T19:34:46.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45332024-11-25T19:34:46.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45342024-11-25T19:34:46.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45352024-11-25T19:34:46.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45362024-11-25T19:34:46.870ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1312, tv_nsec: 416268013 } })
45372024-11-25T19:34:46.870ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
45382024-11-25T19:34:46.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45392024-11-25T19:34:46.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45402024-11-25T19:34:46.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45412024-11-25T19:34:46.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45422024-11-25T19:34:46.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45432024-11-25T19:34:46.872ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45442024-11-25T19:34:46.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45452024-11-25T19:34:46.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45462024-11-25T19:34:46.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45472024-11-25T19:34:46.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45482024-11-25T19:34:46.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45492024-11-25T19:34:46.897ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.45795ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
45502024-11-25T19:34:46.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45512024-11-25T19:34:46.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45522024-11-25T19:34:46.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45532024-11-25T19:34:46.900ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45542024-11-25T19:34:46.900ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45552024-11-25T19:34:46.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45562024-11-25T19:34:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45572024-11-25T19:34:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45582024-11-25T19:34:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45592024-11-25T19:34:46.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.339047ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
45602024-11-25T19:34:46.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45612024-11-25T19:34:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
45622024-11-25T19:34:46.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45632024-11-25T19:34:46.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.055459ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45642024-11-25T19:34:46.905ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45652024-11-25T19:34:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45662024-11-25T19:34:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45672024-11-25T19:34:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45682024-11-25T19:34:46.905ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45692024-11-25T19:34:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45702024-11-25T19:34:46.911ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45712024-11-25T19:34:46.911ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.176679ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45722024-11-25T19:34:46.927ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45732024-11-25T19:34:46.927ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45742024-11-25T19:34:46.927ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b18ff6e-570b-48ec-bbf7-ce158e753e3c", "content-length": "26", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
45752024-11-25T19:34:46.927ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45762024-11-25T19:34:46.929ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45772024-11-25T19:34:46.930ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45782024-11-25T19:34:46.930ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45792024-11-25T19:34:46.931ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "97941062-2d99-4e88-a29f-ac14ba30a71f", "content-length": "26", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
45802024-11-25T19:34:46.931ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45812024-11-25T19:34:46.932ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45822024-11-25T19:34:46.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45832024-11-25T19:34:46.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45842024-11-25T19:34:46.986ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45852024-11-25T19:34:46.986ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45862024-11-25T19:34:46.986ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "09fe97b4-44ac-429d-b30b-c1df2a23ab92", "content-length": "372", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
45872024-11-25T19:34:46.986ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45882024-11-25T19:34:46.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45892024-11-25T19:34:46.989ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45902024-11-25T19:34:46.989ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
45912024-11-25T19:34:46.989ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45922024-11-25T19:34:46.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45932024-11-25T19:34:46.989ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "33a845f3-ab1a-4874-9fa1-aecb2574ac0e", "content-length": "26", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
45942024-11-25T19:34:46.989ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45952024-11-25T19:34:46.991ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
45962024-11-25T19:34:47.004ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
45972024-11-25T19:34:47.004ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 155.94714ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
45982024-11-25T19:34:47.006ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
45992024-11-25T19:34:47.006ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46002024-11-25T19:34:47.007ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d79e74bc-75c2-4e6c-b012-57e0299d5604", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
46012024-11-25T19:34:47.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46022024-11-25T19:34:47.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46032024-11-25T19:34:47.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46042024-11-25T19:34:47.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46052024-11-25T19:34:47.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46062024-11-25T19:34:47.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46072024-11-25T19:34:47.020ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46082024-11-25T19:34:47.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46092024-11-25T19:34:47.025ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46102024-11-25T19:34:47.025ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46112024-11-25T19:34:47.025ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0c5f6c7e-4c02-4fff-a7b7-5f070d2a4ea3", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
46122024-11-25T19:34:47.026ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46132024-11-25T19:34:47.026ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46142024-11-25T19:34:47.026ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 177.788508ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
46152024-11-25T19:34:47.027ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 178.683806ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
46162024-11-25T19:34:47.027ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 178.953841ms iteration = 8 status = {}
46172024-11-25T19:34:47.031ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 181.270936ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46182024-11-25T19:34:47.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46192024-11-25T19:34:47.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
46202024-11-25T19:34:47.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46212024-11-25T19:34:47.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46222024-11-25T19:34:47.039ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 191.428525ms iteration = 8 status = 0
46232024-11-25T19:34:47.056ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 207.802837ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
46242024-11-25T19:34:47.068ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 220.459506ms iteration = 8 status = {}
46252024-11-25T19:34:47.071ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46262024-11-25T19:34:47.071ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0dad7e6-e71f-4490-8dce-9dbcfc0a54f1", "content-length": "1", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
46272024-11-25T19:34:47.073ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46282024-11-25T19:34:47.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46292024-11-25T19:34:47.076ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 228.254008ms iteration = 8 status = null
46302024-11-25T19:34:47.114ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 266.280024ms iteration = 10 status = {"physical_disks_added":0}
46312024-11-25T19:34:47.120ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46322024-11-25T19:34:47.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46332024-11-25T19:34:47.150ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46342024-11-25T19:34:47.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46352024-11-25T19:34:47.150ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46362024-11-25T19:34:47.152ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
46372024-11-25T19:34:47.152ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46382024-11-25T19:34:47.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46392024-11-25T19:34:47.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46402024-11-25T19:34:47.153ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46412024-11-25T19:34:47.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46422024-11-25T19:34:47.162ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46432024-11-25T19:34:47.162ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6cbe692-629e-4a9a-b74d-d99d771b3a80", "content-length": "134", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
46442024-11-25T19:34:47.162ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46452024-11-25T19:34:47.162ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
46462024-11-25T19:34:47.163ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46472024-11-25T19:34:47.163ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46482024-11-25T19:34:47.163ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46492024-11-25T19:34:47.163ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46502024-11-25T19:34:47.163ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46512024-11-25T19:34:47.163ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46522024-11-25T19:34:47.163ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46532024-11-25T19:34:47.163ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46542024-11-25T19:34:47.163ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
46552024-11-25T19:34:47.163ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46562024-11-25T19:34:47.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46572024-11-25T19:34:47.166ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46582024-11-25T19:34:47.166ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1a78eb3-6191-4278-967a-4209b75e6f60", "content-length": "2", "date": "Mon, 25 Nov 2024 19:34:47 GMT"} })
46592024-11-25T19:34:47.166ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46602024-11-25T19:34:47.166ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "50b646d1-7424-4534-a3be-3d5add578485", "content-length": "51", "date": "Mon, 25 Nov 2024 19:34:47 GMT"} })
46612024-11-25T19:34:47.166ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
46622024-11-25T19:34:47.166ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46632024-11-25T19:34:47.189ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46642024-11-25T19:34:47.191ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46652024-11-25T19:34:47.191ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46662024-11-25T19:34:47.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46672024-11-25T19:34:47.237ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46682024-11-25T19:34:47.265ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f004ba83-cf5c-42fc-b2c9-6001e4129b39", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
46692024-11-25T19:34:47.265ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
46702024-11-25T19:34:47.265ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46712024-11-25T19:34:47.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 16b3f0ea-2cfa-47f7-ace9-29adfdf2a178 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
46722024-11-25T19:34:47.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 16b3f0ea-2cfa-47f7-ace9-29adfdf2a178 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
46732024-11-25T19:34:47.266ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "22f3bb73-a838-478a-8026-b6c98f0fd038", "content-length": "682", "date": "Mon, 25 Nov 2024 19:34:47 GMT"} })
46742024-11-25T19:34:47.266ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a2c3051-786e-4bb2-99fb-6cddfc9276c1", "content-length": "691", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
46752024-11-25T19:34:47.266ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
46762024-11-25T19:34:47.266ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
46772024-11-25T19:34:47.266ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
46782024-11-25T19:34:47.266ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46792024-11-25T19:34:47.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46802024-11-25T19:34:47.267ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 419.339377ms iteration = 8 status = {}
46812024-11-25T19:34:47.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 16b3f0ea-2cfa-47f7-ace9-29adfdf2a178 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
46822024-11-25T19:34:47.269ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46832024-11-25T19:34:47.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46842024-11-25T19:34:47.273ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46852024-11-25T19:34:47.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46862024-11-25T19:34:47.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46872024-11-25T19:34:47.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46882024-11-25T19:34:47.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 0f68c19a-7695-4ed2-866e-3425cb750d89 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
46892024-11-25T19:34:47.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 0f68c19a-7695-4ed2-866e-3425cb750d89 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
46902024-11-25T19:34:47.282ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 434.456174ms iteration = 8 status = {}
46912024-11-25T19:34:47.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 0f68c19a-7695-4ed2-866e-3425cb750d89 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
46922024-11-25T19:34:47.325ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
46932024-11-25T19:34:47.325ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
46942024-11-25T19:34:47.355ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
46952024-11-25T19:34:47.355ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:64062
46962024-11-25T19:34:47.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64062 req_id = 60818d84-0639-47c2-a8dd-dc0f9bbb26ea roles = RoleSet { roles: {} } uri = /metrics/producers
46972024-11-25T19:34:47.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64062 req_id = 60818d84-0639-47c2-a8dd-dc0f9bbb26ea resource = Database result = Ok(()) uri = /metrics/producers
46982024-11-25T19:34:47.400ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
46992024-11-25T19:34:47.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44013 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64062 req_id = 60818d84-0639-47c2-a8dd-dc0f9bbb26ea response_code = 201 uri = /metrics/producers
47002024-11-25T19:34:47.400ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "60818d84-0639-47c2-a8dd-dc0f9bbb26ea", "content-length": "41", "date": "Mon, 25 Nov 2024 19:34:47 GMT"} })
47012024-11-25T19:34:47.401ZDEBGnexus (producer-registration-task): registered with nexus successfully
47022024-11-25T19:34:47.401ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
47032024-11-25T19:34:48.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f4e88bab-5069-4e30-8769-86b40077cebd roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47042024-11-25T19:34:48.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f4e88bab-5069-4e30-8769-86b40077cebd resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47052024-11-25T19:34:48.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f4e88bab-5069-4e30-8769-86b40077cebd response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47062024-11-25T19:34:49.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d31ded0e-62e1-480e-b70f-9ee3269c9957 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47072024-11-25T19:34:49.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d31ded0e-62e1-480e-b70f-9ee3269c9957 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47082024-11-25T19:34:49.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d31ded0e-62e1-480e-b70f-9ee3269c9957 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47092024-11-25T19:34:50.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4c0b752e-8572-4141-9ac5-80e071705ebd roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47102024-11-25T19:34:50.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4c0b752e-8572-4141-9ac5-80e071705ebd resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47112024-11-25T19:34:50.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4c0b752e-8572-4141-9ac5-80e071705ebd response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47122024-11-25T19:34:51.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 260a6298-d85c-425c-9027-cea4b0f17c15 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47132024-11-25T19:34:51.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 260a6298-d85c-425c-9027-cea4b0f17c15 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47142024-11-25T19:34:51.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 260a6298-d85c-425c-9027-cea4b0f17c15 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47152024-11-25T19:34:52.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 554 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = f98dcfa9-44c9-496f-a041-cfd3b131f463 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
47162024-11-25T19:34:52.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f8d61faf-167b-4727-8fc4-f3fb5be3e1fe roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47172024-11-25T19:34:52.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f8d61faf-167b-4727-8fc4-f3fb5be3e1fe resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47182024-11-25T19:34:52.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f8d61faf-167b-4727-8fc4-f3fb5be3e1fe response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47192024-11-25T19:34:53.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8ecad718-ad4d-4695-9ebc-4a7dc436b5a0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47202024-11-25T19:34:53.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8ecad718-ad4d-4695-9ebc-4a7dc436b5a0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47212024-11-25T19:34:53.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8ecad718-ad4d-4695-9ebc-4a7dc436b5a0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47222024-11-25T19:34:54.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1c343228-19b4-48fb-83a8-33230673b3eb roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47232024-11-25T19:34:54.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1c343228-19b4-48fb-83a8-33230673b3eb resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47242024-11-25T19:34:54.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1c343228-19b4-48fb-83a8-33230673b3eb response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47252024-11-25T19:34:55.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bb7596a8-274e-490a-ae42-62d9e064d2fc roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47262024-11-25T19:34:55.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bb7596a8-274e-490a-ae42-62d9e064d2fc resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47272024-11-25T19:34:55.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bb7596a8-274e-490a-ae42-62d9e064d2fc response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47282024-11-25T19:34:56.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 102f808c-7ad1-424b-8895-6b5241d798e6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47292024-11-25T19:34:56.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 102f808c-7ad1-424b-8895-6b5241d798e6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47302024-11-25T19:34:56.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 102f808c-7ad1-424b-8895-6b5241d798e6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47312024-11-25T19:34:56.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
47322024-11-25T19:34:56.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
47332024-11-25T19:34:56.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47342024-11-25T19:34:56.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47352024-11-25T19:34:56.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47362024-11-25T19:34:56.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47372024-11-25T19:34:56.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47382024-11-25T19:34:56.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47392024-11-25T19:34:56.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47402024-11-25T19:34:56.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47412024-11-25T19:34:56.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47422024-11-25T19:34:56.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47432024-11-25T19:34:56.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47442024-11-25T19:34:56.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
47452024-11-25T19:34:56.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47462024-11-25T19:34:56.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47472024-11-25T19:34:56.872ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
47482024-11-25T19:34:56.872ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.055603ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
47492024-11-25T19:34:56.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47502024-11-25T19:34:56.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47512024-11-25T19:34:56.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.935826ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47522024-11-25T19:34:57.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aaf4d28e-97e2-4981-b7df-a2b96d79e8c4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47532024-11-25T19:34:57.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aaf4d28e-97e2-4981-b7df-a2b96d79e8c4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47542024-11-25T19:34:57.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aaf4d28e-97e2-4981-b7df-a2b96d79e8c4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47552024-11-25T19:34:58.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9b0905f8-4d3d-4393-92cb-3d72da6dba10 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47562024-11-25T19:34:58.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9b0905f8-4d3d-4393-92cb-3d72da6dba10 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47572024-11-25T19:34:58.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9b0905f8-4d3d-4393-92cb-3d72da6dba10 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47582024-11-25T19:34:59.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 797c1f64-254d-4cd7-bc05-f25b9dcbda4f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47592024-11-25T19:34:59.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 797c1f64-254d-4cd7-bc05-f25b9dcbda4f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47602024-11-25T19:34:59.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 797c1f64-254d-4cd7-bc05-f25b9dcbda4f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47612024-11-25T19:35:00.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9d5b2ea9-d0fa-4611-bfc8-a696b73746b7 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47622024-11-25T19:35:00.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9d5b2ea9-d0fa-4611-bfc8-a696b73746b7 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47632024-11-25T19:35:00.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1893 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9d5b2ea9-d0fa-4611-bfc8-a696b73746b7 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47642024-11-25T19:35:01.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9542fe76-49b4-457d-878f-da5d5bab4d3d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47652024-11-25T19:35:01.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9542fe76-49b4-457d-878f-da5d5bab4d3d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47662024-11-25T19:35:01.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9542fe76-49b4-457d-878f-da5d5bab4d3d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47672024-11-25T19:35:02.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 514 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = c0b11c8c-0c4d-4ad3-8b0f-409435de2955 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
47682024-11-25T19:35:02.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90f2f24e-5e9d-4844-8e18-ee9512188187 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47692024-11-25T19:35:02.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90f2f24e-5e9d-4844-8e18-ee9512188187 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47702024-11-25T19:35:02.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90f2f24e-5e9d-4844-8e18-ee9512188187 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47712024-11-25T19:35:03.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a19f2c7a-5af4-4452-87f2-f64d8e38443d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47722024-11-25T19:35:03.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a19f2c7a-5af4-4452-87f2-f64d8e38443d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47732024-11-25T19:35:03.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a19f2c7a-5af4-4452-87f2-f64d8e38443d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47742024-11-25T19:35:04.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fd08b40b-9fbe-43ac-a8ec-4222d617efb6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47752024-11-25T19:35:04.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fd08b40b-9fbe-43ac-a8ec-4222d617efb6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47762024-11-25T19:35:04.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fd08b40b-9fbe-43ac-a8ec-4222d617efb6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47772024-11-25T19:35:05.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ac0d7e74-b42a-484d-8417-5d88f5c30bee roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47782024-11-25T19:35:05.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ac0d7e74-b42a-484d-8417-5d88f5c30bee resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47792024-11-25T19:35:05.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ac0d7e74-b42a-484d-8417-5d88f5c30bee response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47802024-11-25T19:35:06.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5b256d3c-0b02-43ce-b2bc-72dd745317c9 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47812024-11-25T19:35:06.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5b256d3c-0b02-43ce-b2bc-72dd745317c9 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47822024-11-25T19:35:06.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5b256d3c-0b02-43ce-b2bc-72dd745317c9 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
47832024-11-25T19:35:06.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
47842024-11-25T19:35:06.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
47852024-11-25T19:35:06.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47862024-11-25T19:35:06.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47872024-11-25T19:35:06.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47882024-11-25T19:35:06.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47892024-11-25T19:35:06.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47902024-11-25T19:35:06.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47912024-11-25T19:35:06.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.63479ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47922024-11-25T19:35:06.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47932024-11-25T19:35:06.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47942024-11-25T19:35:06.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47952024-11-25T19:35:06.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47962024-11-25T19:35:06.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47972024-11-25T19:35:06.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47982024-11-25T19:35:06.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47992024-11-25T19:35:06.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
48002024-11-25T19:35:06.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48012024-11-25T19:35:06.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48022024-11-25T19:35:06.910ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
48032024-11-25T19:35:06.910ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.969896ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
48042024-11-25T19:35:07.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4775a92f-8fe6-4e4e-aad6-320b002115ae roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48052024-11-25T19:35:07.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4775a92f-8fe6-4e4e-aad6-320b002115ae resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48062024-11-25T19:35:07.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4775a92f-8fe6-4e4e-aad6-320b002115ae response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48072024-11-25T19:35:08.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1ecc0700-c613-447d-a166-c29603ac2f79 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48082024-11-25T19:35:08.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1ecc0700-c613-447d-a166-c29603ac2f79 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48092024-11-25T19:35:08.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1ecc0700-c613-447d-a166-c29603ac2f79 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48102024-11-25T19:35:09.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c4fca903-0c9b-460a-9b82-de5b50e1a9ed roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48112024-11-25T19:35:09.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c4fca903-0c9b-460a-9b82-de5b50e1a9ed resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48122024-11-25T19:35:09.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c4fca903-0c9b-460a-9b82-de5b50e1a9ed response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48132024-11-25T19:35:10.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 620706a4-276b-44a9-8fb7-e684946c3645 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48142024-11-25T19:35:10.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 620706a4-276b-44a9-8fb7-e684946c3645 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48152024-11-25T19:35:10.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 620706a4-276b-44a9-8fb7-e684946c3645 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48162024-11-25T19:35:11.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c3f9d5e5-4cf8-40b5-98a4-e9cf27357388 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48172024-11-25T19:35:11.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c3f9d5e5-4cf8-40b5-98a4-e9cf27357388 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48182024-11-25T19:35:11.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c3f9d5e5-4cf8-40b5-98a4-e9cf27357388 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48192024-11-25T19:35:12.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 469 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 91a60d54-a083-40a2-9788-62e069acc087 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
48202024-11-25T19:35:12.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 169d8991-565c-42f7-b5a4-cb48c164053a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48212024-11-25T19:35:12.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 169d8991-565c-42f7-b5a4-cb48c164053a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48222024-11-25T19:35:12.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 169d8991-565c-42f7-b5a4-cb48c164053a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48232024-11-25T19:35:13.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5ce40233-fdcf-445b-87a8-49616c0dd738 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48242024-11-25T19:35:13.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5ce40233-fdcf-445b-87a8-49616c0dd738 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48252024-11-25T19:35:13.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5ce40233-fdcf-445b-87a8-49616c0dd738 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48262024-11-25T19:35:14.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ba160286-295e-4b51-98ef-e0e9c71a1962 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48272024-11-25T19:35:14.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ba160286-295e-4b51-98ef-e0e9c71a1962 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48282024-11-25T19:35:14.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ba160286-295e-4b51-98ef-e0e9c71a1962 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48292024-11-25T19:35:15.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90b0a7ce-81f9-4bad-b8b6-5218a93cdfcd roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48302024-11-25T19:35:15.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90b0a7ce-81f9-4bad-b8b6-5218a93cdfcd resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48312024-11-25T19:35:15.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90b0a7ce-81f9-4bad-b8b6-5218a93cdfcd response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
48322024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
48332024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48342024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
48352024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
48362024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
48372024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48382024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48392024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48402024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
48412024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
48422024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
48432024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
48442024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
48452024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
48462024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
48472024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48482024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
48492024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48502024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
48512024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
48522024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
48532024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48542024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
48552024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48562024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
48572024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48582024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
48592024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
48602024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
48612024-11-25T19:35:16.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
48622024-11-25T19:35:16.849ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:25:16.849946935 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
48632024-11-25T19:35:16.849ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
48642024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
48652024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.521\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
48662024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
48672024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
48682024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
48692024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48702024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
48712024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
48722024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
48732024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48742024-11-25T19:35:16.850ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48752024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48762024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48772024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
48782024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48792024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
48802024-11-25T19:35:16.850ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
48812024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
48822024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
48832024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
48842024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
48852024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
48862024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48872024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48882024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
48892024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
48902024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48912024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
48922024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48932024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
48942024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48952024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
48962024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
48972024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48982024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48992024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49002024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49012024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49022024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49032024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49042024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49052024-11-25T19:35:16.850ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1342, tv_nsec: 395328113 } })
49062024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49072024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49082024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
49092024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49102024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49112024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49122024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49132024-11-25T19:35:16.850ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1342, tv_nsec: 395395834 } })
49142024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49152024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49162024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
49172024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49182024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49192024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49202024-11-25T19:35:16.850ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
49212024-11-25T19:35:16.851ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.161363ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
49222024-11-25T19:35:16.851ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
49232024-11-25T19:35:16.851ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.176103ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
49242024-11-25T19:35:16.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49252024-11-25T19:35:16.853ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.775104ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49262024-11-25T19:35:16.853ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1342, tv_nsec: 398755810 } })
49272024-11-25T19:35:16.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
49282024-11-25T19:35:16.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49292024-11-25T19:35:16.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49302024-11-25T19:35:16.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49312024-11-25T19:35:16.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49322024-11-25T19:35:16.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49332024-11-25T19:35:16.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49342024-11-25T19:35:16.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49352024-11-25T19:35:16.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49362024-11-25T19:35:16.860ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:25:16.849946935 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
49372024-11-25T19:35:16.860ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.448196ms iteration = 5 status = {"expiration":"2024-11-25T19:25:16.849946935Z","pruned":[]}
49382024-11-25T19:35:16.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49392024-11-25T19:35:16.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49402024-11-25T19:35:16.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.815352ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
49412024-11-25T19:35:16.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49422024-11-25T19:35:16.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49432024-11-25T19:35:16.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49442024-11-25T19:35:16.865ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.431123ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
49452024-11-25T19:35:16.865ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49462024-11-25T19:35:16.865ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1342, tv_nsec: 410695934 } })
49472024-11-25T19:35:16.866ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
49482024-11-25T19:35:16.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49492024-11-25T19:35:16.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49502024-11-25T19:35:16.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
49512024-11-25T19:35:16.867ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49522024-11-25T19:35:16.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49532024-11-25T19:35:16.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49542024-11-25T19:35:16.875ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49552024-11-25T19:35:16.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49562024-11-25T19:35:16.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49572024-11-25T19:35:16.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49582024-11-25T19:35:16.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
49592024-11-25T19:35:16.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49602024-11-25T19:35:16.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49612024-11-25T19:35:16.882ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49622024-11-25T19:35:16.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49632024-11-25T19:35:16.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49642024-11-25T19:35:16.894ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
49652024-11-25T19:35:16.894ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
49662024-11-25T19:35:16.894ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 45.031884ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
49672024-11-25T19:35:16.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49682024-11-25T19:35:16.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49692024-11-25T19:35:16.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49702024-11-25T19:35:16.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49712024-11-25T19:35:16.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49722024-11-25T19:35:16.898ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49732024-11-25T19:35:16.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49742024-11-25T19:35:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49752024-11-25T19:35:16.901ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49762024-11-25T19:35:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
49772024-11-25T19:35:16.901ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49782024-11-25T19:35:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49792024-11-25T19:35:16.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49802024-11-25T19:35:16.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49812024-11-25T19:35:16.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49822024-11-25T19:35:16.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.591831ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
49832024-11-25T19:35:16.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49842024-11-25T19:35:16.909ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49852024-11-25T19:35:16.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49862024-11-25T19:35:16.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49872024-11-25T19:35:16.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49882024-11-25T19:35:16.911ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49892024-11-25T19:35:16.911ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
49902024-11-25T19:35:16.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49912024-11-25T19:35:16.911ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49922024-11-25T19:35:16.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 62.058548ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49932024-11-25T19:35:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49942024-11-25T19:35:16.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49952024-11-25T19:35:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49962024-11-25T19:35:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49972024-11-25T19:35:16.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49982024-11-25T19:35:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49992024-11-25T19:35:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50002024-11-25T19:35:16.914ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50012024-11-25T19:35:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50022024-11-25T19:35:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
50032024-11-25T19:35:16.915ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50042024-11-25T19:35:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50052024-11-25T19:35:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50062024-11-25T19:35:16.916ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
50072024-11-25T19:35:16.916ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.078717ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
50082024-11-25T19:35:16.917ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50092024-11-25T19:35:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50102024-11-25T19:35:16.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50112024-11-25T19:35:16.918ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50122024-11-25T19:35:16.918ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50132024-11-25T19:35:16.918ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50142024-11-25T19:35:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50152024-11-25T19:35:16.919ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1342, tv_nsec: 464524940 } })
50162024-11-25T19:35:16.920ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
50172024-11-25T19:35:16.920ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.482793ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50182024-11-25T19:35:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50192024-11-25T19:35:16.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50202024-11-25T19:35:16.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50212024-11-25T19:35:16.926ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50222024-11-25T19:35:16.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50232024-11-25T19:35:16.933ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50242024-11-25T19:35:16.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50252024-11-25T19:35:16.935ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50262024-11-25T19:35:16.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50272024-11-25T19:35:16.935ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50282024-11-25T19:35:16.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50292024-11-25T19:35:16.953ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50302024-11-25T19:35:16.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50312024-11-25T19:35:16.959ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50322024-11-25T19:35:16.959ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50332024-11-25T19:35:16.959ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.453237ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50342024-11-25T19:35:16.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 109.997197ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50352024-11-25T19:35:16.959ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
50362024-11-25T19:35:16.959ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
50372024-11-25T19:35:16.959ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
50382024-11-25T19:35:16.959ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50392024-11-25T19:35:16.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50402024-11-25T19:35:16.965ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
50412024-11-25T19:35:16.965ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
50422024-11-25T19:35:16.965ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
50432024-11-25T19:35:16.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50442024-11-25T19:35:16.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50452024-11-25T19:35:16.966ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50462024-11-25T19:35:16.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50472024-11-25T19:35:16.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50482024-11-25T19:35:16.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50492024-11-25T19:35:16.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50502024-11-25T19:35:16.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50512024-11-25T19:35:16.970ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50522024-11-25T19:35:16.970ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 120.406402ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50532024-11-25T19:35:16.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50542024-11-25T19:35:16.971ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
50552024-11-25T19:35:16.971ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
50562024-11-25T19:35:16.971ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
50572024-11-25T19:35:16.971ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50582024-11-25T19:35:16.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50592024-11-25T19:35:16.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50602024-11-25T19:35:16.974ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
50612024-11-25T19:35:16.974ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
50622024-11-25T19:35:16.974ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 124.334069ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
50632024-11-25T19:35:16.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50642024-11-25T19:35:16.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50652024-11-25T19:35:16.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50662024-11-25T19:35:16.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50672024-11-25T19:35:16.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50682024-11-25T19:35:16.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50692024-11-25T19:35:16.976ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
50702024-11-25T19:35:16.976ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
50712024-11-25T19:35:16.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50722024-11-25T19:35:16.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50732024-11-25T19:35:16.979ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
50742024-11-25T19:35:16.979ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
50752024-11-25T19:35:16.979ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
50762024-11-25T19:35:16.979ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 129.821637ms iteration = 5 status = {"generation":1}
50772024-11-25T19:35:16.983ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50782024-11-25T19:35:16.983ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
50792024-11-25T19:35:16.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50802024-11-25T19:35:16.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50812024-11-25T19:35:16.987ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
50822024-11-25T19:35:16.987ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50832024-11-25T19:35:16.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50842024-11-25T19:35:16.995ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50852024-11-25T19:35:16.997ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
50862024-11-25T19:35:16.997ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50872024-11-25T19:35:16.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50882024-11-25T19:35:16.998ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 148.894251ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
50892024-11-25T19:35:17.001ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50902024-11-25T19:35:17.001ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50912024-11-25T19:35:17.002ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "20510207-9564-42b2-8e4d-f7150b2f5d19", "content-length": "26", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
50922024-11-25T19:35:17.002ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50932024-11-25T19:35:17.003ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50942024-11-25T19:35:17.003ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50952024-11-25T19:35:17.003ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50962024-11-25T19:35:17.003ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "91ec8eb1-1abc-41fd-b094-a940f58c554c", "content-length": "26", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
50972024-11-25T19:35:17.003ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50982024-11-25T19:35:17.004ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50992024-11-25T19:35:17.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 27838d75-d345-41a8-b663-ba93dc0041b5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
51002024-11-25T19:35:17.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 27838d75-d345-41a8-b663-ba93dc0041b5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
51012024-11-25T19:35:17.014ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
51022024-11-25T19:35:17.014ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 164.773142ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
51032024-11-25T19:35:17.028ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 178.271827ms iteration = 11 status = {"physical_disks_added":0}
51042024-11-25T19:35:17.068ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
51052024-11-25T19:35:17.068ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51062024-11-25T19:35:17.068ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5cdda985-e2d6-44e0-b99e-2279c8c51990", "content-length": "26", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
51072024-11-25T19:35:17.068ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51082024-11-25T19:35:17.070ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
51092024-11-25T19:35:17.182ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
51102024-11-25T19:35:17.207ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 357.574115ms iteration = 9 status = {}
51112024-11-25T19:35:17.208ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
51122024-11-25T19:35:17.208ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d9408e8-91d0-46ac-9854-fdd2c8a9789e", "content-length": "1", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
51132024-11-25T19:35:17.210ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51142024-11-25T19:35:17.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51152024-11-25T19:35:17.234ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
51162024-11-25T19:35:17.234ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51172024-11-25T19:35:17.234ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd5e153e-430a-4d67-9323-ff0beabc03a0", "content-length": "372", "date": "Mon, 25 Nov 2024 19:35:17 GMT"} })
51182024-11-25T19:35:17.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51192024-11-25T19:35:17.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51202024-11-25T19:35:17.237ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 387.740577ms iteration = 9 status = 0
51212024-11-25T19:35:17.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 27838d75-d345-41a8-b663-ba93dc0041b5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
51222024-11-25T19:35:17.239ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 389.867609ms iteration = 9 status = null
51232024-11-25T19:35:17.261ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
51242024-11-25T19:35:17.262ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "74d7c330-72d5-4684-9888-47f3ef2ae025", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51252024-11-25T19:35:17.262ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51262024-11-25T19:35:17.263ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d11fa46b-d4e3-42d1-a72f-479979c297bd", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51272024-11-25T19:35:17.263ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51282024-11-25T19:35:17.265ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51292024-11-25T19:35:17.265ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 414.979982ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
51302024-11-25T19:35:17.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51312024-11-25T19:35:17.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51322024-11-25T19:35:17.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51332024-11-25T19:35:17.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51342024-11-25T19:35:17.281ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
51352024-11-25T19:35:17.281ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 431.618648ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
51362024-11-25T19:35:17.281ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
51372024-11-25T19:35:17.282ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
51382024-11-25T19:35:17.282ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
51392024-11-25T19:35:17.282ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
51402024-11-25T19:35:17.282ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 432.248861ms iteration = 5 status = {"generation":2}
51412024-11-25T19:35:17.282ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5e62127d-c553-4a8c-a1c1-5345a963d798", "date": "Mon, 25 Nov 2024 19:35:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
51422024-11-25T19:35:17.282ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
51432024-11-25T19:35:17.284ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d40a53b0-9582-4d14-9895-d5ca27e54783", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
51442024-11-25T19:35:17.284ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
51452024-11-25T19:35:17.286ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5234f770-cda5-4e90-9ffb-0fd49fe8fb24", "date": "Mon, 25 Nov 2024 19:35:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
51462024-11-25T19:35:17.286ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
51472024-11-25T19:35:17.288ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
51482024-11-25T19:35:17.288ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 438.34864ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
51492024-11-25T19:35:17.292ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
51502024-11-25T19:35:17.292ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51512024-11-25T19:35:17.292ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "812e5dd7-8049-4e7c-882f-8e9613fe97de", "date": "Mon, 25 Nov 2024 19:35:17 GMT"} })
51522024-11-25T19:35:17.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51532024-11-25T19:35:17.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51542024-11-25T19:35:17.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51552024-11-25T19:35:17.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51562024-11-25T19:35:17.298ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51572024-11-25T19:35:17.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51582024-11-25T19:35:17.302ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
51592024-11-25T19:35:17.302ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51602024-11-25T19:35:17.302ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d418b910-1849-46b8-b97f-ab487e4978ac", "date": "Mon, 25 Nov 2024 19:35:17 GMT"} })
51612024-11-25T19:35:17.304ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 454.64869ms iteration = 9 status = {}
51622024-11-25T19:35:17.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 589049dd-d481-48f1-846e-cfafc39d7761 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
51632024-11-25T19:35:17.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 589049dd-d481-48f1-846e-cfafc39d7761 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
51642024-11-25T19:35:17.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 589049dd-d481-48f1-846e-cfafc39d7761 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
51652024-11-25T19:35:17.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51662024-11-25T19:35:17.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51672024-11-25T19:35:17.333ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51682024-11-25T19:35:17.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51692024-11-25T19:35:17.333ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
51702024-11-25T19:35:17.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51712024-11-25T19:35:17.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51722024-11-25T19:35:17.344ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
51732024-11-25T19:35:17.344ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d34c928c-2e58-45e0-837f-978c439db0d3", "content-length": "134", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
51742024-11-25T19:35:17.344ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
51752024-11-25T19:35:17.344ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
51762024-11-25T19:35:17.344ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
51772024-11-25T19:35:17.344ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51782024-11-25T19:35:17.344ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51792024-11-25T19:35:17.344ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51802024-11-25T19:35:17.344ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51812024-11-25T19:35:17.344ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51822024-11-25T19:35:17.345ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51832024-11-25T19:35:17.345ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51842024-11-25T19:35:17.345ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
51852024-11-25T19:35:17.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51862024-11-25T19:35:17.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51872024-11-25T19:35:17.347ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51882024-11-25T19:35:17.347ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f61f7eb3-672f-449e-988d-61c7e9396cbc", "content-length": "2", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
51892024-11-25T19:35:17.347ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51902024-11-25T19:35:17.347ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4aac394-3898-44b5-ba17-d544ee688b04", "content-length": "51", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
51912024-11-25T19:35:17.347ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
51922024-11-25T19:35:17.347ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51932024-11-25T19:35:17.369ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51942024-11-25T19:35:17.371ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51952024-11-25T19:35:17.371ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51962024-11-25T19:35:17.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51972024-11-25T19:35:17.373ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51982024-11-25T19:35:17.375ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51992024-11-25T19:35:17.375ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52002024-11-25T19:35:17.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52012024-11-25T19:35:17.440ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "848111c2-7ecd-4471-a0d5-fa88365f972c", "date": "Mon, 25 Nov 2024 19:35:17 GMT"} })
52022024-11-25T19:35:17.440ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
52032024-11-25T19:35:17.440ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52042024-11-25T19:35:17.441ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bffbc51-67f5-40a0-8618-0da687159a3b", "content-length": "682", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
52052024-11-25T19:35:17.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52062024-11-25T19:35:17.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52072024-11-25T19:35:17.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52082024-11-25T19:35:17.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52092024-11-25T19:35:17.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52102024-11-25T19:35:17.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52112024-11-25T19:35:17.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52122024-11-25T19:35:17.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52132024-11-25T19:35:17.458ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 608.5646ms iteration = 9 status = {}
52142024-11-25T19:35:17.463ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
52152024-11-25T19:35:17.463ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "eab0f3ef-6443-4384-bd63-6f639a83e863", "content-length": "691", "date": "Mon, 25 Nov 2024 19:35:17 GMT"} })
52162024-11-25T19:35:17.463ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
52172024-11-25T19:35:17.463ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
52182024-11-25T19:35:17.463ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
52192024-11-25T19:35:17.465ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 616.086747ms iteration = 9 status = {}
52202024-11-25T19:35:18.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9bb890f3-935f-4fc9-96f7-b6d9b810dc3a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52212024-11-25T19:35:18.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9bb890f3-935f-4fc9-96f7-b6d9b810dc3a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52222024-11-25T19:35:18.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9bb890f3-935f-4fc9-96f7-b6d9b810dc3a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52232024-11-25T19:35:19.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 16090c66-dfd4-4f9a-9ba6-1486dafedb3a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52242024-11-25T19:35:19.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 16090c66-dfd4-4f9a-9ba6-1486dafedb3a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52252024-11-25T19:35:19.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 16090c66-dfd4-4f9a-9ba6-1486dafedb3a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52262024-11-25T19:35:20.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8a37eb68-7430-43ed-b488-123017712c79 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52272024-11-25T19:35:20.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8a37eb68-7430-43ed-b488-123017712c79 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52282024-11-25T19:35:20.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8a37eb68-7430-43ed-b488-123017712c79 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52292024-11-25T19:35:21.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 957a2e54-1382-4445-894c-194ad2fd3509 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52302024-11-25T19:35:21.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 957a2e54-1382-4445-894c-194ad2fd3509 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52312024-11-25T19:35:21.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2855 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 957a2e54-1382-4445-894c-194ad2fd3509 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52322024-11-25T19:35:22.287ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 852 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = a7bfebcb-4742-4942-9e0c-c62448da47a9 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
52332024-11-25T19:35:22.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fc91c2ae-0d34-4c73-9600-4325d951989a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52342024-11-25T19:35:22.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fc91c2ae-0d34-4c73-9600-4325d951989a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52352024-11-25T19:35:22.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fc91c2ae-0d34-4c73-9600-4325d951989a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52362024-11-25T19:35:23.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c54cc1b7-5319-444b-911d-532f6705bd8f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52372024-11-25T19:35:23.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c54cc1b7-5319-444b-911d-532f6705bd8f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52382024-11-25T19:35:23.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c54cc1b7-5319-444b-911d-532f6705bd8f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52392024-11-25T19:35:24.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4e8dfe9a-3760-4787-83f1-9fd19c64fa90 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52402024-11-25T19:35:24.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4e8dfe9a-3760-4787-83f1-9fd19c64fa90 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52412024-11-25T19:35:24.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4e8dfe9a-3760-4787-83f1-9fd19c64fa90 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52422024-11-25T19:35:25.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d2b4d8dc-71f3-4e94-8913-95978dcc1c37 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52432024-11-25T19:35:25.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d2b4d8dc-71f3-4e94-8913-95978dcc1c37 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52442024-11-25T19:35:25.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d2b4d8dc-71f3-4e94-8913-95978dcc1c37 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52452024-11-25T19:35:26.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7b86dabb-f7c5-41ca-892b-a73306e638a4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52462024-11-25T19:35:26.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7b86dabb-f7c5-41ca-892b-a73306e638a4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52472024-11-25T19:35:26.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7b86dabb-f7c5-41ca-892b-a73306e638a4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52482024-11-25T19:35:26.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
52492024-11-25T19:35:26.850ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
52502024-11-25T19:35:26.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52512024-11-25T19:35:26.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52522024-11-25T19:35:26.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52532024-11-25T19:35:26.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52542024-11-25T19:35:26.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52552024-11-25T19:35:26.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52562024-11-25T19:35:26.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52572024-11-25T19:35:26.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52582024-11-25T19:35:26.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52592024-11-25T19:35:26.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52602024-11-25T19:35:26.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52612024-11-25T19:35:26.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
52622024-11-25T19:35:26.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52632024-11-25T19:35:26.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52642024-11-25T19:35:26.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
52652024-11-25T19:35:26.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.556643ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
52662024-11-25T19:35:26.879ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52672024-11-25T19:35:26.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52682024-11-25T19:35:26.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.489396ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52692024-11-25T19:35:27.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fc38a19a-347d-4732-8630-771bafc1346c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52702024-11-25T19:35:27.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fc38a19a-347d-4732-8630-771bafc1346c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52712024-11-25T19:35:27.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fc38a19a-347d-4732-8630-771bafc1346c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52722024-11-25T19:35:28.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 20972d2a-8052-4318-8963-b3d797391176 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52732024-11-25T19:35:28.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 20972d2a-8052-4318-8963-b3d797391176 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52742024-11-25T19:35:28.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 20972d2a-8052-4318-8963-b3d797391176 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52752024-11-25T19:35:29.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5326f272-1c4f-4747-83f1-e185dacf4881 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52762024-11-25T19:35:29.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5326f272-1c4f-4747-83f1-e185dacf4881 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52772024-11-25T19:35:29.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5326f272-1c4f-4747-83f1-e185dacf4881 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52782024-11-25T19:35:30.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 77d961a1-f689-4dea-9b94-49ffcf3ed7f7 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52792024-11-25T19:35:30.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 77d961a1-f689-4dea-9b94-49ffcf3ed7f7 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52802024-11-25T19:35:30.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 77d961a1-f689-4dea-9b94-49ffcf3ed7f7 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52812024-11-25T19:35:31.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6e9fcf95-65ca-4521-9f1d-b8a810d2d7f0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52822024-11-25T19:35:31.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6e9fcf95-65ca-4521-9f1d-b8a810d2d7f0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52832024-11-25T19:35:31.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6e9fcf95-65ca-4521-9f1d-b8a810d2d7f0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52842024-11-25T19:35:32.287ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 599 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = f57b6d87-0850-4ef6-a1f4-b9b642651609 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
52852024-11-25T19:35:32.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 032aee8c-1f9f-4c19-a96a-105f5b152d03 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52862024-11-25T19:35:32.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 032aee8c-1f9f-4c19-a96a-105f5b152d03 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52872024-11-25T19:35:32.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 032aee8c-1f9f-4c19-a96a-105f5b152d03 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52882024-11-25T19:35:33.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1fad1ce6-cf1f-4bce-bcb6-147bf911d6ee roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52892024-11-25T19:35:33.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1fad1ce6-cf1f-4bce-bcb6-147bf911d6ee resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52902024-11-25T19:35:33.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1fad1ce6-cf1f-4bce-bcb6-147bf911d6ee response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52912024-11-25T19:35:34.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 367a4689-2121-4ce5-8783-84281cabe29b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52922024-11-25T19:35:34.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 367a4689-2121-4ce5-8783-84281cabe29b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52932024-11-25T19:35:34.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 367a4689-2121-4ce5-8783-84281cabe29b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52942024-11-25T19:35:35.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ca7ccf85-5838-4c44-a722-eeca61befd7a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52952024-11-25T19:35:35.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ca7ccf85-5838-4c44-a722-eeca61befd7a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52962024-11-25T19:35:35.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ca7ccf85-5838-4c44-a722-eeca61befd7a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52972024-11-25T19:35:36.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d783da59-d4b6-4b27-83ee-8caa2211b010 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52982024-11-25T19:35:36.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d783da59-d4b6-4b27-83ee-8caa2211b010 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
52992024-11-25T19:35:36.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d783da59-d4b6-4b27-83ee-8caa2211b010 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53002024-11-25T19:35:36.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
53012024-11-25T19:35:36.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
53022024-11-25T19:35:36.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53032024-11-25T19:35:36.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53042024-11-25T19:35:36.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53052024-11-25T19:35:36.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53062024-11-25T19:35:36.879ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53072024-11-25T19:35:36.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53082024-11-25T19:35:36.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53092024-11-25T19:35:36.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53102024-11-25T19:35:36.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53112024-11-25T19:35:36.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53122024-11-25T19:35:36.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53132024-11-25T19:35:36.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53142024-11-25T19:35:36.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.530919ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53152024-11-25T19:35:36.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53162024-11-25T19:35:36.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
53172024-11-25T19:35:36.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53182024-11-25T19:35:36.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53192024-11-25T19:35:36.926ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
53202024-11-25T19:35:36.926ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.592653ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
53212024-11-25T19:35:37.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f34fe50c-3a58-45f1-8787-9c513b1492d8 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53222024-11-25T19:35:37.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f34fe50c-3a58-45f1-8787-9c513b1492d8 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53232024-11-25T19:35:37.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f34fe50c-3a58-45f1-8787-9c513b1492d8 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53242024-11-25T19:35:38.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 46bae48b-0cf4-4bde-a765-b0bf504272bf roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53252024-11-25T19:35:38.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 46bae48b-0cf4-4bde-a765-b0bf504272bf resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53262024-11-25T19:35:38.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 46bae48b-0cf4-4bde-a765-b0bf504272bf response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53272024-11-25T19:35:39.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6c9cc27a-147b-41e0-b406-4a96ba3a1f2e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53282024-11-25T19:35:39.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6c9cc27a-147b-41e0-b406-4a96ba3a1f2e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53292024-11-25T19:35:39.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6c9cc27a-147b-41e0-b406-4a96ba3a1f2e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53302024-11-25T19:35:40.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7962a2aa-e635-4d1b-ad82-95d505a13d94 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53312024-11-25T19:35:40.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7962a2aa-e635-4d1b-ad82-95d505a13d94 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53322024-11-25T19:35:40.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1743 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7962a2aa-e635-4d1b-ad82-95d505a13d94 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53332024-11-25T19:35:41.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5506c4c4-5539-4472-a5dd-d0216ecb3f1f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53342024-11-25T19:35:41.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5506c4c4-5539-4472-a5dd-d0216ecb3f1f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53352024-11-25T19:35:41.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5506c4c4-5539-4472-a5dd-d0216ecb3f1f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53362024-11-25T19:35:42.287ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 543 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 14264186-9e3c-4596-b9ab-3511fb844c69 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
53372024-11-25T19:35:42.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6e9352fe-6e22-4416-b1a1-a5a986729d47 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53382024-11-25T19:35:42.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6e9352fe-6e22-4416-b1a1-a5a986729d47 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53392024-11-25T19:35:42.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6e9352fe-6e22-4416-b1a1-a5a986729d47 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53402024-11-25T19:35:43.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4a2d9952-1597-4ab0-9c72-37bd23bbe739 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53412024-11-25T19:35:43.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4a2d9952-1597-4ab0-9c72-37bd23bbe739 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53422024-11-25T19:35:43.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4a2d9952-1597-4ab0-9c72-37bd23bbe739 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53432024-11-25T19:35:44.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e6f09be6-fc61-4539-98d7-1f39581325f6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53442024-11-25T19:35:44.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e6f09be6-fc61-4539-98d7-1f39581325f6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53452024-11-25T19:35:44.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e6f09be6-fc61-4539-98d7-1f39581325f6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53462024-11-25T19:35:45.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2a1c063f-30ec-44c5-96c0-7491f0988354 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53472024-11-25T19:35:45.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2a1c063f-30ec-44c5-96c0-7491f0988354 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53482024-11-25T19:35:45.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2a1c063f-30ec-44c5-96c0-7491f0988354 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
53492024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
53502024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
53512024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53522024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
53532024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
53542024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53552024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
53562024-11-25T19:35:46.850ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
53572024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
53582024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53592024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53602024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
53612024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53622024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
53632024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
53642024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53652024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53662024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
53672024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53682024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
53692024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53702024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
53712024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
53722024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53732024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53742024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
53752024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53762024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
53772024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
53782024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53792024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
53802024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53812024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53822024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
53832024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53842024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53852024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53862024-11-25T19:35:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53872024-11-25T19:35:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53882024-11-25T19:35:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53892024-11-25T19:35:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53902024-11-25T19:35:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53912024-11-25T19:35:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53922024-11-25T19:35:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53932024-11-25T19:35:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53942024-11-25T19:35:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53952024-11-25T19:35:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53962024-11-25T19:35:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53972024-11-25T19:35:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53982024-11-25T19:35:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53992024-11-25T19:35:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54002024-11-25T19:35:46.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 447e7a4f-246a-44c8-a019-f41f01727d20 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
54012024-11-25T19:35:46.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 447e7a4f-246a-44c8-a019-f41f01727d20 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
54022024-11-25T19:35:46.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54032024-11-25T19:35:46.855ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.776454ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54042024-11-25T19:35:46.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54052024-11-25T19:35:46.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54062024-11-25T19:35:46.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54072024-11-25T19:35:46.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54082024-11-25T19:35:46.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54092024-11-25T19:35:46.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54102024-11-25T19:35:46.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54112024-11-25T19:35:46.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54122024-11-25T19:35:46.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54132024-11-25T19:35:46.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54142024-11-25T19:35:46.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54152024-11-25T19:35:46.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54162024-11-25T19:35:46.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54172024-11-25T19:35:46.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1372, tv_nsec: 405135445 } })
54182024-11-25T19:35:46.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
54192024-11-25T19:35:46.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1372, tv_nsec: 405896340 } })
54202024-11-25T19:35:46.862ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
54212024-11-25T19:35:46.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54222024-11-25T19:35:46.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54232024-11-25T19:35:46.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54242024-11-25T19:35:46.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54252024-11-25T19:35:46.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54262024-11-25T19:35:46.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54272024-11-25T19:35:46.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 447e7a4f-246a-44c8-a019-f41f01727d20 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
54282024-11-25T19:35:46.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54292024-11-25T19:35:46.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54302024-11-25T19:35:46.876ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1372, tv_nsec: 420215741 } })
54312024-11-25T19:35:46.876ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
54322024-11-25T19:35:46.877ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54332024-11-25T19:35:46.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54342024-11-25T19:35:46.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54352024-11-25T19:35:46.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54362024-11-25T19:35:46.890ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 40.293431ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
54372024-11-25T19:35:46.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54382024-11-25T19:35:46.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54392024-11-25T19:35:46.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54402024-11-25T19:35:46.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54412024-11-25T19:35:46.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54422024-11-25T19:35:46.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54432024-11-25T19:35:46.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54442024-11-25T19:35:46.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54452024-11-25T19:35:46.898ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54462024-11-25T19:35:46.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54472024-11-25T19:35:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54482024-11-25T19:35:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54492024-11-25T19:35:46.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.172454ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54502024-11-25T19:35:46.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54512024-11-25T19:35:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54522024-11-25T19:35:46.906ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54532024-11-25T19:35:46.906ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 55.856046ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54542024-11-25T19:35:46.906ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54552024-11-25T19:35:46.906ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54562024-11-25T19:35:46.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54572024-11-25T19:35:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54582024-11-25T19:35:46.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54592024-11-25T19:35:46.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54602024-11-25T19:35:46.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54612024-11-25T19:35:46.908ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54622024-11-25T19:35:46.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54632024-11-25T19:35:46.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.406216ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
54642024-11-25T19:35:46.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
54652024-11-25T19:35:46.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54662024-11-25T19:35:46.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54672024-11-25T19:35:46.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54682024-11-25T19:35:46.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54692024-11-25T19:35:46.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 62.763081ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54702024-11-25T19:35:46.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54712024-11-25T19:35:46.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54722024-11-25T19:35:46.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54732024-11-25T19:35:46.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54742024-11-25T19:35:46.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54752024-11-25T19:35:46.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54762024-11-25T19:35:46.921ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
54772024-11-25T19:35:46.921ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.695927ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
54782024-11-25T19:35:46.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.328734ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
54792024-11-25T19:35:46.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 85.551009ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
54802024-11-25T19:35:46.940ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54812024-11-25T19:35:46.940ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54822024-11-25T19:35:46.940ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54832024-11-25T19:35:46.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54842024-11-25T19:35:46.944ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54852024-11-25T19:35:46.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
54862024-11-25T19:35:46.947ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54872024-11-25T19:35:46.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54882024-11-25T19:35:46.950ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 100.204676ms iteration = 10 status = 0
54892024-11-25T19:35:46.954ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
54902024-11-25T19:35:46.954ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54912024-11-25T19:35:46.954ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e0bff48-6218-4d45-a6c2-cc1bb1f79c2d", "content-length": "26", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
54922024-11-25T19:35:46.954ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54932024-11-25T19:35:46.956ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
54942024-11-25T19:35:46.956ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54952024-11-25T19:35:46.956ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ae1d42d-e29e-4170-89aa-b6488c4895e8", "content-length": "26", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
54962024-11-25T19:35:46.956ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54972024-11-25T19:35:46.956ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54982024-11-25T19:35:46.957ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54992024-11-25T19:35:46.959ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
55002024-11-25T19:35:46.959ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55012024-11-25T19:35:46.959ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8beacf95-584a-48fa-a878-da6f7743d141", "content-length": "26", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
55022024-11-25T19:35:46.959ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55032024-11-25T19:35:46.960ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
55042024-11-25T19:35:46.976ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55052024-11-25T19:35:46.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55062024-11-25T19:35:46.977ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55072024-11-25T19:35:46.977ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55082024-11-25T19:35:46.977ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 127.348449ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55092024-11-25T19:35:47.013ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 163.08291ms iteration = 12 status = {"physical_disks_added":0}
55102024-11-25T19:35:47.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55112024-11-25T19:35:47.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55122024-11-25T19:35:47.021ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55132024-11-25T19:35:47.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55142024-11-25T19:35:47.023ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55152024-11-25T19:35:47.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55162024-11-25T19:35:47.025ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55172024-11-25T19:35:47.027ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55182024-11-25T19:35:47.027ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55192024-11-25T19:35:47.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55202024-11-25T19:35:47.057ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 207.42239ms iteration = 10 status = {}
55212024-11-25T19:35:47.066ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55222024-11-25T19:35:47.066ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "47d0bf18-c125-4f68-93bf-f0bd309c34ce", "content-length": "1", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
55232024-11-25T19:35:47.068ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55242024-11-25T19:35:47.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55252024-11-25T19:35:47.070ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 219.749041ms iteration = 10 status = null
55262024-11-25T19:35:47.123ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55272024-11-25T19:35:47.124ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "885f0937-d44e-4eb2-8ea0-83930f658595", "content-length": "691", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
55282024-11-25T19:35:47.124ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
55292024-11-25T19:35:47.124ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
55302024-11-25T19:35:47.124ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
55312024-11-25T19:35:47.125ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 275.279371ms iteration = 10 status = {}
55322024-11-25T19:35:47.154ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55332024-11-25T19:35:47.154ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55342024-11-25T19:35:47.154ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b1979c3-65bb-4a24-8cd6-89cd2d5b94c1", "content-length": "372", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
55352024-11-25T19:35:47.154ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55362024-11-25T19:35:47.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55372024-11-25T19:35:47.203ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
55382024-11-25T19:35:47.204ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55392024-11-25T19:35:47.204ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "91d1b04a-b4dc-4761-b970-f4b1db957b12", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
55402024-11-25T19:35:47.204ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55412024-11-25T19:35:47.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55422024-11-25T19:35:47.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55432024-11-25T19:35:47.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55442024-11-25T19:35:47.209ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55452024-11-25T19:35:47.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55462024-11-25T19:35:47.214ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
55472024-11-25T19:35:47.214ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55482024-11-25T19:35:47.214ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "59616655-4b98-4233-b548-61b8559e4c95", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
55492024-11-25T19:35:47.216ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 366.068982ms iteration = 10 status = {}
55502024-11-25T19:35:47.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55512024-11-25T19:35:47.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55522024-11-25T19:35:47.225ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
55532024-11-25T19:35:47.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55542024-11-25T19:35:47.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55552024-11-25T19:35:47.233ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
55562024-11-25T19:35:47.234ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7ad9514-a577-406d-a87b-0fff1cac74dd", "content-length": "134", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
55572024-11-25T19:35:47.234ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
55582024-11-25T19:35:47.234ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
55592024-11-25T19:35:47.234ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
55602024-11-25T19:35:47.234ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55612024-11-25T19:35:47.234ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55622024-11-25T19:35:47.234ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55632024-11-25T19:35:47.234ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55642024-11-25T19:35:47.234ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55652024-11-25T19:35:47.234ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55662024-11-25T19:35:47.234ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55672024-11-25T19:35:47.234ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
55682024-11-25T19:35:47.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55692024-11-25T19:35:47.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55702024-11-25T19:35:47.236ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
55712024-11-25T19:35:47.236ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5bcfea5-760a-4712-9daf-9217f5b2c1f1", "content-length": "2", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
55722024-11-25T19:35:47.236ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
55732024-11-25T19:35:47.236ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1f1d5ea-1b2f-4898-8de6-a7885ac9d9b4", "content-length": "51", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
55742024-11-25T19:35:47.236ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
55752024-11-25T19:35:47.236ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55762024-11-25T19:35:47.329ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "525a788b-9562-4ebf-a6b8-284f5bf3ab2e", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
55772024-11-25T19:35:47.329ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
55782024-11-25T19:35:47.329ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55792024-11-25T19:35:47.330ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "75c135b3-4b6a-4d8f-a96d-0a2a241cb693", "content-length": "682", "date": "Mon, 25 Nov 2024 19:35:47 GMT"} })
55802024-11-25T19:35:47.330ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55812024-11-25T19:35:47.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55822024-11-25T19:35:47.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55832024-11-25T19:35:47.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55842024-11-25T19:35:47.337ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55852024-11-25T19:35:47.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55862024-11-25T19:35:47.339ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55872024-11-25T19:35:47.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55882024-11-25T19:35:47.346ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 496.147455ms iteration = 10 status = {}
55892024-11-25T19:35:47.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 9aab1bb9-5194-4688-8b49-a52619abc6be roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
55902024-11-25T19:35:47.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 9aab1bb9-5194-4688-8b49-a52619abc6be resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
55912024-11-25T19:35:47.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 9aab1bb9-5194-4688-8b49-a52619abc6be response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
55922024-11-25T19:35:47.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3e5627b5-399a-4f79-b014-8298d0299360 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
55932024-11-25T19:35:47.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3e5627b5-399a-4f79-b014-8298d0299360 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
55942024-11-25T19:35:47.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3e5627b5-399a-4f79-b014-8298d0299360 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
55952024-11-25T19:35:48.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8b227d3e-b6cd-4ad6-b9d4-4782d6bd67a3 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
55962024-11-25T19:35:48.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8b227d3e-b6cd-4ad6-b9d4-4782d6bd67a3 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
55972024-11-25T19:35:48.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8b227d3e-b6cd-4ad6-b9d4-4782d6bd67a3 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
55982024-11-25T19:35:49.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d94e2605-f77c-4f2e-a06e-2e6ac654cf23 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
55992024-11-25T19:35:49.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d94e2605-f77c-4f2e-a06e-2e6ac654cf23 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56002024-11-25T19:35:49.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d94e2605-f77c-4f2e-a06e-2e6ac654cf23 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56012024-11-25T19:35:50.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4dd56930-a1c9-403c-a341-26c574ee3a79 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56022024-11-25T19:35:50.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4dd56930-a1c9-403c-a341-26c574ee3a79 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56032024-11-25T19:35:50.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4dd56930-a1c9-403c-a341-26c574ee3a79 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56042024-11-25T19:35:51.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c358d69d-f557-4657-bd75-28d8fcc52b4b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56052024-11-25T19:35:51.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c358d69d-f557-4657-bd75-28d8fcc52b4b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56062024-11-25T19:35:51.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c358d69d-f557-4657-bd75-28d8fcc52b4b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56072024-11-25T19:35:52.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 522 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 0b37592c-ef2e-4849-a4a7-70cf19fca2c7 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
56082024-11-25T19:35:53.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8e55591c-1d59-4285-9f4c-7aff0505f914 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56092024-11-25T19:35:53.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8e55591c-1d59-4285-9f4c-7aff0505f914 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56102024-11-25T19:35:53.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8e55591c-1d59-4285-9f4c-7aff0505f914 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56112024-11-25T19:35:54.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 18b3e8b5-6523-47bc-8f32-e9bb0d77405a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56122024-11-25T19:35:54.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 18b3e8b5-6523-47bc-8f32-e9bb0d77405a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56132024-11-25T19:35:54.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 18b3e8b5-6523-47bc-8f32-e9bb0d77405a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56142024-11-25T19:35:55.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2138b9a2-1c0e-4c84-857b-262a3b637b0a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56152024-11-25T19:35:55.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2138b9a2-1c0e-4c84-857b-262a3b637b0a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56162024-11-25T19:35:55.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2138b9a2-1c0e-4c84-857b-262a3b637b0a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56172024-11-25T19:35:56.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 59dd570c-b273-4c9e-9737-efc8efd33ad8 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56182024-11-25T19:35:56.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 59dd570c-b273-4c9e-9737-efc8efd33ad8 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56192024-11-25T19:35:56.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 59dd570c-b273-4c9e-9737-efc8efd33ad8 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56202024-11-25T19:35:56.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
56212024-11-25T19:35:56.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
56222024-11-25T19:35:56.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56232024-11-25T19:35:56.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56242024-11-25T19:35:56.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56252024-11-25T19:35:56.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56262024-11-25T19:35:56.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56272024-11-25T19:35:56.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56282024-11-25T19:35:56.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56292024-11-25T19:35:56.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56302024-11-25T19:35:56.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56312024-11-25T19:35:56.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56322024-11-25T19:35:56.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56332024-11-25T19:35:56.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
56342024-11-25T19:35:56.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56352024-11-25T19:35:56.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56362024-11-25T19:35:56.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
56372024-11-25T19:35:56.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.921979ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
56382024-11-25T19:35:56.881ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56392024-11-25T19:35:56.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56402024-11-25T19:35:56.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.994167ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56412024-11-25T19:35:57.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dbcad0aa-c873-4c0c-b325-908af3fef3fb roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56422024-11-25T19:35:57.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dbcad0aa-c873-4c0c-b325-908af3fef3fb resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56432024-11-25T19:35:57.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dbcad0aa-c873-4c0c-b325-908af3fef3fb response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56442024-11-25T19:35:58.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad5f3aa9-87c0-4cc8-b91c-a4743e933703 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56452024-11-25T19:35:58.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad5f3aa9-87c0-4cc8-b91c-a4743e933703 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56462024-11-25T19:35:58.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad5f3aa9-87c0-4cc8-b91c-a4743e933703 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56472024-11-25T19:35:59.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2d471222-6d3e-47d3-b55a-688e19952ad8 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56482024-11-25T19:35:59.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2d471222-6d3e-47d3-b55a-688e19952ad8 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56492024-11-25T19:35:59.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2d471222-6d3e-47d3-b55a-688e19952ad8 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56502024-11-25T19:36:00.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0f36f765-343e-4e9c-9a6f-6822db0825b8 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56512024-11-25T19:36:00.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0f36f765-343e-4e9c-9a6f-6822db0825b8 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56522024-11-25T19:36:00.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0f36f765-343e-4e9c-9a6f-6822db0825b8 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56532024-11-25T19:36:01.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1992f609-45ca-4c63-9c1f-5df6ab47cb59 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56542024-11-25T19:36:01.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1992f609-45ca-4c63-9c1f-5df6ab47cb59 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56552024-11-25T19:36:01.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1893 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1992f609-45ca-4c63-9c1f-5df6ab47cb59 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56562024-11-25T19:36:02.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = eb1289e5-a6de-4d46-9d8b-1dea57c4d82c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56572024-11-25T19:36:02.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = eb1289e5-a6de-4d46-9d8b-1dea57c4d82c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56582024-11-25T19:36:02.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = eb1289e5-a6de-4d46-9d8b-1dea57c4d82c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56592024-11-25T19:36:02.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 542 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 1bbfe024-ab0a-4ed4-b873-ea9441073cdf response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
56602024-11-25T19:36:03.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6a85275f-a16c-4779-bd27-0044469a7be3 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56612024-11-25T19:36:03.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6a85275f-a16c-4779-bd27-0044469a7be3 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56622024-11-25T19:36:03.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6a85275f-a16c-4779-bd27-0044469a7be3 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56632024-11-25T19:36:04.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 122c97a0-b958-42e2-83bf-c4fedf7608b9 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56642024-11-25T19:36:04.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 122c97a0-b958-42e2-83bf-c4fedf7608b9 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56652024-11-25T19:36:04.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 122c97a0-b958-42e2-83bf-c4fedf7608b9 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56662024-11-25T19:36:05.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 683daf73-4bc5-469d-8173-17438ce3c160 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56672024-11-25T19:36:05.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 683daf73-4bc5-469d-8173-17438ce3c160 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56682024-11-25T19:36:05.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 683daf73-4bc5-469d-8173-17438ce3c160 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56692024-11-25T19:36:06.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad9053ab-d069-49cd-a991-fe8d34a36d03 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56702024-11-25T19:36:06.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad9053ab-d069-49cd-a991-fe8d34a36d03 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56712024-11-25T19:36:06.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad9053ab-d069-49cd-a991-fe8d34a36d03 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56722024-11-25T19:36:06.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
56732024-11-25T19:36:06.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
56742024-11-25T19:36:06.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56752024-11-25T19:36:06.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56762024-11-25T19:36:06.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56772024-11-25T19:36:06.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56782024-11-25T19:36:06.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56792024-11-25T19:36:06.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56802024-11-25T19:36:06.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56812024-11-25T19:36:06.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.366725ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56822024-11-25T19:36:06.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56832024-11-25T19:36:06.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56842024-11-25T19:36:06.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56852024-11-25T19:36:06.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56862024-11-25T19:36:06.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56872024-11-25T19:36:06.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56882024-11-25T19:36:06.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
56892024-11-25T19:36:06.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56902024-11-25T19:36:06.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56912024-11-25T19:36:06.867ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
56922024-11-25T19:36:06.867ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.666316ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
56932024-11-25T19:36:07.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6568fc32-5154-4dec-addb-c36a82c33cef roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56942024-11-25T19:36:07.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6568fc32-5154-4dec-addb-c36a82c33cef resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56952024-11-25T19:36:07.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6568fc32-5154-4dec-addb-c36a82c33cef response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56962024-11-25T19:36:08.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fd75521b-6213-4db6-b9d2-0280a6ea4a6b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56972024-11-25T19:36:08.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fd75521b-6213-4db6-b9d2-0280a6ea4a6b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56982024-11-25T19:36:08.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fd75521b-6213-4db6-b9d2-0280a6ea4a6b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
56992024-11-25T19:36:09.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 69b8bf84-489f-48af-9c5f-06a29bef93e4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57002024-11-25T19:36:09.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 69b8bf84-489f-48af-9c5f-06a29bef93e4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57012024-11-25T19:36:09.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 69b8bf84-489f-48af-9c5f-06a29bef93e4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57022024-11-25T19:36:10.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 63662b27-6ae9-4c71-ae52-0d3d28a1f700 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57032024-11-25T19:36:10.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 63662b27-6ae9-4c71-ae52-0d3d28a1f700 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57042024-11-25T19:36:10.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 63662b27-6ae9-4c71-ae52-0d3d28a1f700 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57052024-11-25T19:36:11.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad937b45-9be6-4108-bd24-509a9dd1b93f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57062024-11-25T19:36:11.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad937b45-9be6-4108-bd24-509a9dd1b93f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57072024-11-25T19:36:11.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad937b45-9be6-4108-bd24-509a9dd1b93f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57082024-11-25T19:36:12.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 637 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 67fe630d-1092-4a98-ab07-b1829b52bcad response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
57092024-11-25T19:36:12.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d49cc0ac-57d6-411f-873a-a88362f89d50 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57102024-11-25T19:36:12.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d49cc0ac-57d6-411f-873a-a88362f89d50 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57112024-11-25T19:36:12.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1863 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d49cc0ac-57d6-411f-873a-a88362f89d50 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57122024-11-25T19:36:13.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 58e7cc17-cbb9-4521-884e-65107d201b48 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57132024-11-25T19:36:13.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 58e7cc17-cbb9-4521-884e-65107d201b48 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57142024-11-25T19:36:13.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 58e7cc17-cbb9-4521-884e-65107d201b48 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57152024-11-25T19:36:14.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 63e24761-6ccc-4d8c-b546-b8026469e783 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57162024-11-25T19:36:14.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 63e24761-6ccc-4d8c-b546-b8026469e783 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57172024-11-25T19:36:14.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 63e24761-6ccc-4d8c-b546-b8026469e783 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57182024-11-25T19:36:15.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7c2e4a1e-8d51-4bd3-ab25-94c0235929e0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57192024-11-25T19:36:15.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7c2e4a1e-8d51-4bd3-ab25-94c0235929e0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57202024-11-25T19:36:15.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7c2e4a1e-8d51-4bd3-ab25-94c0235929e0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57212024-11-25T19:36:16.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 08d51e06-ce35-48b1-af3a-f2d6a72a9eb8 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57222024-11-25T19:36:16.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 08d51e06-ce35-48b1-af3a-f2d6a72a9eb8 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57232024-11-25T19:36:16.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 08d51e06-ce35-48b1-af3a-f2d6a72a9eb8 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
57242024-11-25T19:36:16.847ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
57252024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
57262024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57272024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
57282024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57292024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57302024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
57312024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57322024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
57332024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
57342024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57352024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
57362024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
57372024-11-25T19:36:16.848ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
57382024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57392024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
57402024-11-25T19:36:16.848ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
57412024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.08\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
57422024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
57432024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
57442024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
57452024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
57462024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57472024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
57482024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
57492024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
57502024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57512024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
57522024-11-25T19:36:16.848ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:26:16.848167261 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
57532024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
57542024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
57552024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
57562024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57572024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
57582024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57592024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
57602024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57612024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
57622024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57632024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57642024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
57652024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57662024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
57672024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57682024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
57692024-11-25T19:36:16.848ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
57702024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
57712024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57722024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
57732024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57742024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
57752024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57762024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
57772024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57782024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
57792024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
57802024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57812024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
57822024-11-25T19:36:16.848ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57832024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57842024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
57852024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
57862024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
57872024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
57882024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57892024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57902024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57912024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57922024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57932024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57942024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57952024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
57962024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57972024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57982024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
57992024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58002024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58012024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58022024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
58032024-11-25T19:36:16.848ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1402, tv_nsec: 395288092 } })
58042024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58052024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58062024-11-25T19:36:16.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58072024-11-25T19:36:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58082024-11-25T19:36:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58092024-11-25T19:36:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58102024-11-25T19:36:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58112024-11-25T19:36:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58122024-11-25T19:36:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58132024-11-25T19:36:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58142024-11-25T19:36:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
58152024-11-25T19:36:16.849ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1402, tv_nsec: 395472405 } })
58162024-11-25T19:36:16.849ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
58172024-11-25T19:36:16.849ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.046261ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
58182024-11-25T19:36:16.849ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
58192024-11-25T19:36:16.849ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.433708ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
58202024-11-25T19:36:16.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58212024-11-25T19:36:16.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58222024-11-25T19:36:16.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58232024-11-25T19:36:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58242024-11-25T19:36:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.634921ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58252024-11-25T19:36:16.852ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58262024-11-25T19:36:16.852ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1402, tv_nsec: 399357681 } })
58272024-11-25T19:36:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58282024-11-25T19:36:16.853ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
58292024-11-25T19:36:16.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58302024-11-25T19:36:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58312024-11-25T19:36:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58322024-11-25T19:36:16.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58332024-11-25T19:36:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58342024-11-25T19:36:16.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58352024-11-25T19:36:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58362024-11-25T19:36:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58372024-11-25T19:36:16.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58382024-11-25T19:36:16.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.798943ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
58392024-11-25T19:36:16.857ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58402024-11-25T19:36:16.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58412024-11-25T19:36:16.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58422024-11-25T19:36:16.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58432024-11-25T19:36:16.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58442024-11-25T19:36:16.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58452024-11-25T19:36:16.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58462024-11-25T19:36:16.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58472024-11-25T19:36:16.860ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:26:16.848167261 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
58482024-11-25T19:36:16.860ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.309382ms iteration = 6 status = {"expiration":"2024-11-25T19:26:16.848167261Z","pruned":[]}
58492024-11-25T19:36:16.861ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58502024-11-25T19:36:16.861ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
58512024-11-25T19:36:16.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58522024-11-25T19:36:16.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58532024-11-25T19:36:16.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1402, tv_nsec: 408150614 } })
58542024-11-25T19:36:16.862ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
58552024-11-25T19:36:16.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58562024-11-25T19:36:16.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58572024-11-25T19:36:16.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58582024-11-25T19:36:16.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58592024-11-25T19:36:16.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58602024-11-25T19:36:16.864ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58612024-11-25T19:36:16.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58622024-11-25T19:36:16.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58632024-11-25T19:36:16.864ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58642024-11-25T19:36:16.865ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.243128ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
58652024-11-25T19:36:16.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
58662024-11-25T19:36:16.866ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
58672024-11-25T19:36:16.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58682024-11-25T19:36:16.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
58692024-11-25T19:36:16.866ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58702024-11-25T19:36:16.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58712024-11-25T19:36:16.868ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58722024-11-25T19:36:16.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58732024-11-25T19:36:16.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58742024-11-25T19:36:16.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58752024-11-25T19:36:16.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58762024-11-25T19:36:16.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58772024-11-25T19:36:16.871ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1402, tv_nsec: 417467327 } })
58782024-11-25T19:36:16.871ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
58792024-11-25T19:36:16.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58802024-11-25T19:36:16.872ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58812024-11-25T19:36:16.872ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58822024-11-25T19:36:16.872ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58832024-11-25T19:36:16.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58842024-11-25T19:36:16.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58852024-11-25T19:36:16.873ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58862024-11-25T19:36:16.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58872024-11-25T19:36:16.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58882024-11-25T19:36:16.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58892024-11-25T19:36:16.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58902024-11-25T19:36:16.878ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58912024-11-25T19:36:16.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58922024-11-25T19:36:16.879ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58932024-11-25T19:36:16.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
58942024-11-25T19:36:16.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58952024-11-25T19:36:16.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58962024-11-25T19:36:16.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
58972024-11-25T19:36:16.883ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58982024-11-25T19:36:16.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58992024-11-25T19:36:16.887ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59002024-11-25T19:36:16.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59012024-11-25T19:36:16.889ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59022024-11-25T19:36:16.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59032024-11-25T19:36:16.896ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59042024-11-25T19:36:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
59052024-11-25T19:36:16.901ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59062024-11-25T19:36:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59072024-11-25T19:36:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59082024-11-25T19:36:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59092024-11-25T19:36:16.905ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59102024-11-25T19:36:16.905ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
59112024-11-25T19:36:16.905ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
59122024-11-25T19:36:16.905ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.764733ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
59132024-11-25T19:36:16.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59142024-11-25T19:36:16.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.011428ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
59152024-11-25T19:36:16.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59162024-11-25T19:36:16.907ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59172024-11-25T19:36:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59182024-11-25T19:36:16.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 60.063248ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59192024-11-25T19:36:16.908ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
59202024-11-25T19:36:16.908ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.66005ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
59212024-11-25T19:36:16.909ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59222024-11-25T19:36:16.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59232024-11-25T19:36:16.909ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59242024-11-25T19:36:16.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
59252024-11-25T19:36:16.910ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59262024-11-25T19:36:16.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59272024-11-25T19:36:16.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 63.635908ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
59282024-11-25T19:36:16.912ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59292024-11-25T19:36:16.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.785761ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59302024-11-25T19:36:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59312024-11-25T19:36:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
59322024-11-25T19:36:16.912ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59332024-11-25T19:36:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59342024-11-25T19:36:16.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59352024-11-25T19:36:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59362024-11-25T19:36:16.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59372024-11-25T19:36:16.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59382024-11-25T19:36:16.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59392024-11-25T19:36:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59402024-11-25T19:36:16.917ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59412024-11-25T19:36:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59422024-11-25T19:36:16.919ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59432024-11-25T19:36:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59442024-11-25T19:36:16.920ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
59452024-11-25T19:36:16.921ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
59462024-11-25T19:36:16.921ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 72.701547ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
59472024-11-25T19:36:16.921ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59482024-11-25T19:36:16.921ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59492024-11-25T19:36:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59502024-11-25T19:36:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59512024-11-25T19:36:16.923ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59522024-11-25T19:36:16.923ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59532024-11-25T19:36:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59542024-11-25T19:36:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59552024-11-25T19:36:16.924ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59562024-11-25T19:36:16.924ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.985311ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59572024-11-25T19:36:16.924ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
59582024-11-25T19:36:16.924ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
59592024-11-25T19:36:16.924ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
59602024-11-25T19:36:16.924ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59612024-11-25T19:36:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59622024-11-25T19:36:16.924ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
59632024-11-25T19:36:16.924ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
59642024-11-25T19:36:16.924ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
59652024-11-25T19:36:16.924ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59662024-11-25T19:36:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59672024-11-25T19:36:16.925ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59682024-11-25T19:36:16.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59692024-11-25T19:36:16.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59702024-11-25T19:36:16.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59712024-11-25T19:36:16.927ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59722024-11-25T19:36:16.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59732024-11-25T19:36:16.927ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59742024-11-25T19:36:16.927ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
59752024-11-25T19:36:16.927ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 79.572962ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
59762024-11-25T19:36:16.928ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59772024-11-25T19:36:16.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59782024-11-25T19:36:16.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59792024-11-25T19:36:16.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59802024-11-25T19:36:16.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59812024-11-25T19:36:16.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59822024-11-25T19:36:16.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59832024-11-25T19:36:16.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
59842024-11-25T19:36:16.932ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59852024-11-25T19:36:16.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59862024-11-25T19:36:16.933ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
59872024-11-25T19:36:16.933ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
59882024-11-25T19:36:16.933ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59892024-11-25T19:36:16.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59902024-11-25T19:36:16.934ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59912024-11-25T19:36:16.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59922024-11-25T19:36:16.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59932024-11-25T19:36:16.936ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
59942024-11-25T19:36:16.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
59952024-11-25T19:36:16.936ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59962024-11-25T19:36:16.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59972024-11-25T19:36:16.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59982024-11-25T19:36:16.938ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59992024-11-25T19:36:16.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60002024-11-25T19:36:16.939ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60012024-11-25T19:36:16.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60022024-11-25T19:36:16.940ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
60032024-11-25T19:36:16.941ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
60042024-11-25T19:36:16.941ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
60052024-11-25T19:36:16.941ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 92.725789ms iteration = 6 status = {"generation":1}
60062024-11-25T19:36:16.942ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60072024-11-25T19:36:16.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60082024-11-25T19:36:16.946ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60092024-11-25T19:36:16.947ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60102024-11-25T19:36:16.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60112024-11-25T19:36:16.947ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60122024-11-25T19:36:16.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60132024-11-25T19:36:16.949ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60142024-11-25T19:36:16.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
60152024-11-25T19:36:16.950ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60162024-11-25T19:36:16.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60172024-11-25T19:36:16.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60182024-11-25T19:36:16.951ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60192024-11-25T19:36:16.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60202024-11-25T19:36:16.952ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 104.183453ms iteration = 11 status = 0
60212024-11-25T19:36:16.953ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60222024-11-25T19:36:16.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60232024-11-25T19:36:16.954ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60242024-11-25T19:36:16.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60252024-11-25T19:36:16.954ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60262024-11-25T19:36:16.957ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60272024-11-25T19:36:16.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60282024-11-25T19:36:16.958ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
60292024-11-25T19:36:16.958ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60302024-11-25T19:36:16.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60312024-11-25T19:36:16.960ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60322024-11-25T19:36:16.960ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60332024-11-25T19:36:16.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60342024-11-25T19:36:16.961ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60352024-11-25T19:36:16.961ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60362024-11-25T19:36:16.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60372024-11-25T19:36:16.963ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60382024-11-25T19:36:16.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60392024-11-25T19:36:16.963ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60402024-11-25T19:36:16.965ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60412024-11-25T19:36:16.965ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
60422024-11-25T19:36:16.965ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60432024-11-25T19:36:16.965ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60442024-11-25T19:36:16.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60452024-11-25T19:36:16.970ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
60462024-11-25T19:36:16.970ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60472024-11-25T19:36:16.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60482024-11-25T19:36:16.971ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
60492024-11-25T19:36:16.971ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
60502024-11-25T19:36:16.971ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60512024-11-25T19:36:16.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60522024-11-25T19:36:16.972ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
60532024-11-25T19:36:16.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60542024-11-25T19:36:16.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
60552024-11-25T19:36:16.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60562024-11-25T19:36:16.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60572024-11-25T19:36:16.976ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60582024-11-25T19:36:16.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60592024-11-25T19:36:16.976ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60602024-11-25T19:36:16.978ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
60612024-11-25T19:36:16.978ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
60622024-11-25T19:36:16.978ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
60632024-11-25T19:36:16.978ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 129.872477ms iteration = 6 status = {"generation":2}
60642024-11-25T19:36:16.979ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60652024-11-25T19:36:16.979ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60662024-11-25T19:36:16.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60672024-11-25T19:36:16.985ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 136.896236ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
60682024-11-25T19:36:17.015ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
60692024-11-25T19:36:17.015ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60702024-11-25T19:36:17.015ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "44fd678f-c778-41c2-99c5-185aa297e169", "content-length": "26", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
60712024-11-25T19:36:17.015ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60722024-11-25T19:36:17.017ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60732024-11-25T19:36:17.042ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 194.945055ms iteration = 13 status = {"physical_disks_added":0}
60742024-11-25T19:36:17.055ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
60752024-11-25T19:36:17.055ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 207.122173ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
60762024-11-25T19:36:17.071ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
60772024-11-25T19:36:17.071ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60782024-11-25T19:36:17.072ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e351582-d9b7-484c-ae1d-bc02bd9386ba", "content-length": "26", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
60792024-11-25T19:36:17.072ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60802024-11-25T19:36:17.074ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60812024-11-25T19:36:17.144ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
60822024-11-25T19:36:17.144ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "978e2fb2-b8bd-4980-9406-6efd28b16437", "content-length": "691", "date": "Mon, 25 Nov 2024 19:36:17 GMT"} })
60832024-11-25T19:36:17.144ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
60842024-11-25T19:36:17.144ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
60852024-11-25T19:36:17.144ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
60862024-11-25T19:36:17.146ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 298.21413ms iteration = 11 status = {}
60872024-11-25T19:36:17.146ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60882024-11-25T19:36:17.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60892024-11-25T19:36:17.149ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60902024-11-25T19:36:17.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60912024-11-25T19:36:17.182ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
60922024-11-25T19:36:17.182ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60932024-11-25T19:36:17.182ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3748b0d-0c2f-4740-8e38-5c3ef25b0137", "content-length": "26", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
60942024-11-25T19:36:17.182ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60952024-11-25T19:36:17.185ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
60962024-11-25T19:36:17.185ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
60972024-11-25T19:36:17.185ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "52090003-7d55-4dd9-bf15-59cac4b69081", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60982024-11-25T19:36:17.185ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60992024-11-25T19:36:17.186ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4e361e1b-397d-48ae-afbb-c72765d9a89f", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61002024-11-25T19:36:17.186ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61012024-11-25T19:36:17.188ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61022024-11-25T19:36:17.188ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 340.086233ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
61032024-11-25T19:36:17.188ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
61042024-11-25T19:36:17.188ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 340.48106ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
61052024-11-25T19:36:17.193ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
61062024-11-25T19:36:17.203ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
61072024-11-25T19:36:17.203ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61082024-11-25T19:36:17.203ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d920439-722a-439a-912e-f7d2834d63ac", "content-length": "372", "date": "Mon, 25 Nov 2024 19:36:17 GMT"} })
61092024-11-25T19:36:17.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61102024-11-25T19:36:17.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61112024-11-25T19:36:17.206ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61122024-11-25T19:36:17.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61132024-11-25T19:36:17.209ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61142024-11-25T19:36:17.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61152024-11-25T19:36:17.211ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61162024-11-25T19:36:17.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61172024-11-25T19:36:17.216ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61182024-11-25T19:36:17.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61192024-11-25T19:36:17.217ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61202024-11-25T19:36:17.221ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
61212024-11-25T19:36:17.221ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61222024-11-25T19:36:17.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61232024-11-25T19:36:17.222ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61242024-11-25T19:36:17.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61252024-11-25T19:36:17.224ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61262024-11-25T19:36:17.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61272024-11-25T19:36:17.226ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61282024-11-25T19:36:17.226ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
61292024-11-25T19:36:17.227ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5af91726-be13-4dd1-89d2-3da427303714", "content-length": "1", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
61302024-11-25T19:36:17.228ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61312024-11-25T19:36:17.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61322024-11-25T19:36:17.229ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
61332024-11-25T19:36:17.229ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61342024-11-25T19:36:17.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61352024-11-25T19:36:17.231ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 383.139517ms iteration = 11 status = null
61362024-11-25T19:36:17.236ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
61372024-11-25T19:36:17.236ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61382024-11-25T19:36:17.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61392024-11-25T19:36:17.237ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61402024-11-25T19:36:17.239ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
61412024-11-25T19:36:17.239ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61422024-11-25T19:36:17.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61432024-11-25T19:36:17.241ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
61442024-11-25T19:36:17.241ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
61452024-11-25T19:36:17.241ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
61462024-11-25T19:36:17.254ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
61472024-11-25T19:36:17.254ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
61482024-11-25T19:36:17.254ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "40f5bd7a-3b71-49ee-bd12-8239c494919e", "date": "Mon, 25 Nov 2024 19:36:17 GMT"} })
61492024-11-25T19:36:17.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61502024-11-25T19:36:17.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61512024-11-25T19:36:17.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61522024-11-25T19:36:17.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61532024-11-25T19:36:17.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61542024-11-25T19:36:17.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61552024-11-25T19:36:17.262ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
61562024-11-25T19:36:17.262ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61572024-11-25T19:36:17.262ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "aee1b77f-8b90-4b50-85ad-790b3991996f", "date": "Mon, 25 Nov 2024 19:36:17 GMT"} })
61582024-11-25T19:36:17.264ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 416.040413ms iteration = 11 status = {}
61592024-11-25T19:36:17.265ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 417.053832ms iteration = 11 status = {}
61602024-11-25T19:36:17.288ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
61612024-11-25T19:36:17.289ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a4405b88-87bd-4324-a5b7-8af4175e22de", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61622024-11-25T19:36:17.289ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61632024-11-25T19:36:17.290ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d5559673-ac05-4f52-a894-60c22dafd3f0", "date": "Mon, 25 Nov 2024 19:36:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61642024-11-25T19:36:17.290ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61652024-11-25T19:36:17.292ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "515e1ac0-f77e-4735-9eb2-0809169de9c1", "date": "Mon, 25 Nov 2024 19:36:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61662024-11-25T19:36:17.292ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61672024-11-25T19:36:17.294ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61682024-11-25T19:36:17.294ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 446.360058ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
61692024-11-25T19:36:17.300ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 38711855-ef69-4d79-bb75-aebd85b1280b, time_created: 2024-11-25T19:31:33.165388Z, time_modified: 2024-11-25T19:31:33.165388Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
61702024-11-25T19:36:17.300ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
61712024-11-25T19:36:17.300ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61722024-11-25T19:36:17.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61732024-11-25T19:36:17.302ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61742024-11-25T19:36:17.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61752024-11-25T19:36:17.304ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61762024-11-25T19:36:17.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
61772024-11-25T19:36:17.343ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
61782024-11-25T19:36:17.344ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "be323f89-497a-4c1d-a07e-7ff21979168e", "date": "Mon, 25 Nov 2024 19:36:17 GMT"} })
61792024-11-25T19:36:17.346ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
61802024-11-25T19:36:17.346ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 498.228385ms
61812024-11-25T19:36:17.346ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 498.238275ms iteration = 2 status = {}
61822024-11-25T19:36:17.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61832024-11-25T19:36:17.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61842024-11-25T19:36:17.356ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
61852024-11-25T19:36:17.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61862024-11-25T19:36:17.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61872024-11-25T19:36:17.365ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
61882024-11-25T19:36:17.365ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f312dd5-8240-4a0d-a90b-7d19cd9b4967", "content-length": "134", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
61892024-11-25T19:36:17.365ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
61902024-11-25T19:36:17.365ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
61912024-11-25T19:36:17.365ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
61922024-11-25T19:36:17.365ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
61932024-11-25T19:36:17.365ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61942024-11-25T19:36:17.365ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61952024-11-25T19:36:17.365ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61962024-11-25T19:36:17.366ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61972024-11-25T19:36:17.366ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61982024-11-25T19:36:17.366ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61992024-11-25T19:36:17.366ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
62002024-11-25T19:36:17.366ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62012024-11-25T19:36:17.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62022024-11-25T19:36:17.368ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
62032024-11-25T19:36:17.368ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2839cd93-f5af-4239-a11e-bd95becb9a66", "content-length": "2", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
62042024-11-25T19:36:17.368ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
62052024-11-25T19:36:17.368ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "279ab6bb-ced2-4037-b649-38b1cd674ec2", "content-length": "51", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
62062024-11-25T19:36:17.368ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
62072024-11-25T19:36:17.369ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
62082024-11-25T19:36:17.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = e0b22c67-3469-4472-b19e-4bf45d18406b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
62092024-11-25T19:36:17.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = e0b22c67-3469-4472-b19e-4bf45d18406b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
62102024-11-25T19:36:17.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = e0b22c67-3469-4472-b19e-4bf45d18406b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
62112024-11-25T19:36:17.460ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fb1f536e-2065-44d5-8e00-d0ab3a5e353f", "date": "Mon, 25 Nov 2024 19:36:17 GMT"} })
62122024-11-25T19:36:17.460ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
62132024-11-25T19:36:17.460ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
62142024-11-25T19:36:17.461ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b792a67-0e2a-4876-bf84-f2f7e7528277", "content-length": "682", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
62152024-11-25T19:36:17.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62162024-11-25T19:36:17.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62172024-11-25T19:36:17.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62182024-11-25T19:36:17.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62192024-11-25T19:36:17.466ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62202024-11-25T19:36:17.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62212024-11-25T19:36:17.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62222024-11-25T19:36:17.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62232024-11-25T19:36:17.475ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 627.027382ms iteration = 11 status = {}
62242024-11-25T19:36:17.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2df341c9-5881-4734-8b10-795234dae5e3 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62252024-11-25T19:36:17.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2df341c9-5881-4734-8b10-795234dae5e3 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62262024-11-25T19:36:17.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2df341c9-5881-4734-8b10-795234dae5e3 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62272024-11-25T19:36:18.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 18d071b3-862e-4de4-a6a8-a268082a6731 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62282024-11-25T19:36:18.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 18d071b3-862e-4de4-a6a8-a268082a6731 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62292024-11-25T19:36:18.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 18d071b3-862e-4de4-a6a8-a268082a6731 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62302024-11-25T19:36:19.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 00e5a6af-277d-46b1-a7a2-b57049ee283c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62312024-11-25T19:36:19.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 00e5a6af-277d-46b1-a7a2-b57049ee283c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62322024-11-25T19:36:19.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 00e5a6af-277d-46b1-a7a2-b57049ee283c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62332024-11-25T19:36:20.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 54a38d9a-584d-4487-856b-e3ed4be50f4b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62342024-11-25T19:36:20.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 54a38d9a-584d-4487-856b-e3ed4be50f4b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62352024-11-25T19:36:20.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 54a38d9a-584d-4487-856b-e3ed4be50f4b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62362024-11-25T19:36:21.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ebdc2894-c75d-4c0b-9634-5cd8d18ca5a3 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62372024-11-25T19:36:21.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ebdc2894-c75d-4c0b-9634-5cd8d18ca5a3 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62382024-11-25T19:36:21.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ebdc2894-c75d-4c0b-9634-5cd8d18ca5a3 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62392024-11-25T19:36:22.277ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:48601
62402024-11-25T19:36:22.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 7d75ca9d-3c78-4f77-9237-ba6f6ddee85d roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
62412024-11-25T19:36:22.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 7d75ca9d-3c78-4f77-9237-ba6f6ddee85d resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
62422024-11-25T19:36:22.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 7d75ca9d-3c78-4f77-9237-ba6f6ddee85d response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
62432024-11-25T19:36:22.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = d7128f2b-a184-42b7-bda3-071fa9e933ed roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
62442024-11-25T19:36:22.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = d7128f2b-a184-42b7-bda3-071fa9e933ed resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
62452024-11-25T19:36:22.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = d7128f2b-a184-42b7-bda3-071fa9e933ed response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
62462024-11-25T19:36:22.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 457 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 06835cc0-73bc-4c24-addc-879c213b87cf response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
62472024-11-25T19:36:22.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d8341e5d-99de-4be0-bef7-0dcb2207ca8b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62482024-11-25T19:36:22.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d8341e5d-99de-4be0-bef7-0dcb2207ca8b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62492024-11-25T19:36:22.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1896 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d8341e5d-99de-4be0-bef7-0dcb2207ca8b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62502024-11-25T19:36:23.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5f756578-9e1c-4b95-84f7-b0dc0b256c5b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62512024-11-25T19:36:23.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5f756578-9e1c-4b95-84f7-b0dc0b256c5b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62522024-11-25T19:36:23.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5f756578-9e1c-4b95-84f7-b0dc0b256c5b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62532024-11-25T19:36:24.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e1c442d5-3c69-490f-be57-053adf167659 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62542024-11-25T19:36:24.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e1c442d5-3c69-490f-be57-053adf167659 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62552024-11-25T19:36:24.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e1c442d5-3c69-490f-be57-053adf167659 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62562024-11-25T19:36:25.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f44dd9aa-ba12-4861-adea-7788a998c157 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62572024-11-25T19:36:25.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f44dd9aa-ba12-4861-adea-7788a998c157 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62582024-11-25T19:36:25.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f44dd9aa-ba12-4861-adea-7788a998c157 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62592024-11-25T19:36:26.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 68f625e0-687a-4d47-9e72-a824e01b28a9 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62602024-11-25T19:36:26.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 68f625e0-687a-4d47-9e72-a824e01b28a9 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62612024-11-25T19:36:26.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 68f625e0-687a-4d47-9e72-a824e01b28a9 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62622024-11-25T19:36:26.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
62632024-11-25T19:36:26.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
62642024-11-25T19:36:26.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62652024-11-25T19:36:26.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62662024-11-25T19:36:26.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62672024-11-25T19:36:26.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62682024-11-25T19:36:26.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62692024-11-25T19:36:26.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62702024-11-25T19:36:26.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62712024-11-25T19:36:26.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.53626ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62722024-11-25T19:36:26.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62732024-11-25T19:36:26.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62742024-11-25T19:36:26.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62752024-11-25T19:36:26.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62762024-11-25T19:36:26.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62772024-11-25T19:36:26.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62782024-11-25T19:36:26.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
62792024-11-25T19:36:26.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62802024-11-25T19:36:26.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62812024-11-25T19:36:26.872ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
62822024-11-25T19:36:26.872ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.768446ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
62832024-11-25T19:36:27.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 347e044b-5113-46ad-9646-3de14da0479a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62842024-11-25T19:36:27.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 347e044b-5113-46ad-9646-3de14da0479a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62852024-11-25T19:36:27.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 347e044b-5113-46ad-9646-3de14da0479a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62862024-11-25T19:36:28.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 857f1d4c-95f4-4d72-bf80-e407c90abb3b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62872024-11-25T19:36:28.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 857f1d4c-95f4-4d72-bf80-e407c90abb3b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62882024-11-25T19:36:28.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 857f1d4c-95f4-4d72-bf80-e407c90abb3b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62892024-11-25T19:36:29.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b026b25e-80e3-4bdc-a6c7-4255c8cfc094 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62902024-11-25T19:36:29.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b026b25e-80e3-4bdc-a6c7-4255c8cfc094 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62912024-11-25T19:36:29.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b026b25e-80e3-4bdc-a6c7-4255c8cfc094 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62922024-11-25T19:36:30.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2bf229c9-ee5f-4a53-a76b-85243ff6ee48 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62932024-11-25T19:36:30.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2bf229c9-ee5f-4a53-a76b-85243ff6ee48 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62942024-11-25T19:36:30.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2bf229c9-ee5f-4a53-a76b-85243ff6ee48 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62952024-11-25T19:36:31.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 621582ac-895b-4263-bdd2-e7d5c3f69764 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62962024-11-25T19:36:31.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 621582ac-895b-4263-bdd2-e7d5c3f69764 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62972024-11-25T19:36:31.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 621582ac-895b-4263-bdd2-e7d5c3f69764 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
62982024-11-25T19:36:32.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 577 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 27cf1cf1-24a3-46a6-bc58-0f101bb495ed response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
62992024-11-25T19:36:32.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 40794173-307c-4e61-b44a-59e983c432c8 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63002024-11-25T19:36:32.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 40794173-307c-4e61-b44a-59e983c432c8 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63012024-11-25T19:36:32.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 40794173-307c-4e61-b44a-59e983c432c8 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63022024-11-25T19:36:33.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a60bf1a9-5e63-43ec-852f-0a7c1ecb38b8 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63032024-11-25T19:36:33.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a60bf1a9-5e63-43ec-852f-0a7c1ecb38b8 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63042024-11-25T19:36:33.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a60bf1a9-5e63-43ec-852f-0a7c1ecb38b8 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63052024-11-25T19:36:34.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 40508ba7-4b16-4f54-b2d3-2a46bf0ce707 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63062024-11-25T19:36:34.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 40508ba7-4b16-4f54-b2d3-2a46bf0ce707 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63072024-11-25T19:36:34.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 40508ba7-4b16-4f54-b2d3-2a46bf0ce707 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63082024-11-25T19:36:35.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 164efca0-a149-4147-9fcc-7ffd5969f08e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63092024-11-25T19:36:35.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 164efca0-a149-4147-9fcc-7ffd5969f08e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63102024-11-25T19:36:35.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 164efca0-a149-4147-9fcc-7ffd5969f08e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63112024-11-25T19:36:36.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
63122024-11-25T19:36:36.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
63132024-11-25T19:36:36.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63142024-11-25T19:36:36.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63152024-11-25T19:36:36.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63162024-11-25T19:36:36.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63172024-11-25T19:36:36.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63182024-11-25T19:36:36.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63192024-11-25T19:36:36.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63202024-11-25T19:36:36.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.413446ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63212024-11-25T19:36:36.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63222024-11-25T19:36:36.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63232024-11-25T19:36:36.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63242024-11-25T19:36:36.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63252024-11-25T19:36:36.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63262024-11-25T19:36:36.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63272024-11-25T19:36:36.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
63282024-11-25T19:36:36.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63292024-11-25T19:36:36.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63302024-11-25T19:36:36.868ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
63312024-11-25T19:36:36.868ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.623205ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
63322024-11-25T19:36:36.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 34b1c75b-dcd1-468e-978d-6d9a94a1d84f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63332024-11-25T19:36:36.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 34b1c75b-dcd1-468e-978d-6d9a94a1d84f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63342024-11-25T19:36:36.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 34b1c75b-dcd1-468e-978d-6d9a94a1d84f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63352024-11-25T19:36:37.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c8f1d049-a40b-4487-bf90-de1b64b6c729 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63362024-11-25T19:36:37.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c8f1d049-a40b-4487-bf90-de1b64b6c729 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63372024-11-25T19:36:37.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c8f1d049-a40b-4487-bf90-de1b64b6c729 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63382024-11-25T19:36:38.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a01641a1-86f7-495c-82d1-179b322f04e1 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63392024-11-25T19:36:38.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a01641a1-86f7-495c-82d1-179b322f04e1 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63402024-11-25T19:36:38.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a01641a1-86f7-495c-82d1-179b322f04e1 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63412024-11-25T19:36:39.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 81d305e6-c8ce-435f-8d84-9dc2561543dd roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63422024-11-25T19:36:39.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 81d305e6-c8ce-435f-8d84-9dc2561543dd resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63432024-11-25T19:36:39.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 81d305e6-c8ce-435f-8d84-9dc2561543dd response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63442024-11-25T19:36:41.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 54bff506-53c2-4592-9b07-b603fd02dfa8 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63452024-11-25T19:36:41.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 54bff506-53c2-4592-9b07-b603fd02dfa8 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63462024-11-25T19:36:41.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 54bff506-53c2-4592-9b07-b603fd02dfa8 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63472024-11-25T19:36:42.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0f6d5f9d-2b94-467e-bf58-7ffc751ba342 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63482024-11-25T19:36:42.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0f6d5f9d-2b94-467e-bf58-7ffc751ba342 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63492024-11-25T19:36:42.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0f6d5f9d-2b94-467e-bf58-7ffc751ba342 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63502024-11-25T19:36:42.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 624 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = e2403f15-0a49-4d84-953f-ae53de756181 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
63512024-11-25T19:36:43.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a495ee71-92ab-4b14-aee7-6a934f21a130 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63522024-11-25T19:36:43.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a495ee71-92ab-4b14-aee7-6a934f21a130 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63532024-11-25T19:36:43.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a495ee71-92ab-4b14-aee7-6a934f21a130 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63542024-11-25T19:36:44.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1e3662d5-869b-42ea-be3e-8eaeda7997ac roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63552024-11-25T19:36:44.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1e3662d5-869b-42ea-be3e-8eaeda7997ac resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63562024-11-25T19:36:44.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1e3662d5-869b-42ea-be3e-8eaeda7997ac response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63572024-11-25T19:36:45.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c9ac10b6-96ca-433d-bdb6-b43698d8c6c6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63582024-11-25T19:36:45.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c9ac10b6-96ca-433d-bdb6-b43698d8c6c6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63592024-11-25T19:36:45.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c9ac10b6-96ca-433d-bdb6-b43698d8c6c6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63602024-11-25T19:36:46.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b6895d5a-7d3f-4641-bf2a-0c0aed3a9c23 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63612024-11-25T19:36:46.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b6895d5a-7d3f-4641-bf2a-0c0aed3a9c23 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63622024-11-25T19:36:46.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b6895d5a-7d3f-4641-bf2a-0c0aed3a9c23 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
63632024-11-25T19:36:46.848ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
63642024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
63652024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
63662024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
63672024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63682024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
63692024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63702024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
63712024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
63722024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
63732024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
63742024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63752024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63762024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
63772024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63782024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
63792024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
63802024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
63812024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63822024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
63832024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
63842024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63852024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
63862024-11-25T19:36:46.849ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
63872024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63882024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
63892024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63902024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
63912024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
63922024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
63932024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63942024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63952024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
63962024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63972024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63982024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
63992024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
64002024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64012024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64022024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
64032024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64042024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64052024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64062024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64072024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64082024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64092024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64102024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64112024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64122024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64132024-11-25T19:36:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64142024-11-25T19:36:46.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.882677ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
64152024-11-25T19:36:46.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64162024-11-25T19:36:46.852ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.337586ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
64172024-11-25T19:36:46.852ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1432, tv_nsec: 398615007 } })
64182024-11-25T19:36:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64192024-11-25T19:36:46.852ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
64202024-11-25T19:36:46.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64212024-11-25T19:36:46.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64222024-11-25T19:36:46.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1432, tv_nsec: 400321770 } })
64232024-11-25T19:36:46.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
64242024-11-25T19:36:46.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64252024-11-25T19:36:46.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64262024-11-25T19:36:46.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64272024-11-25T19:36:46.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64282024-11-25T19:36:46.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64292024-11-25T19:36:46.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64302024-11-25T19:36:46.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64312024-11-25T19:36:46.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64322024-11-25T19:36:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64332024-11-25T19:36:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
64342024-11-25T19:36:46.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64352024-11-25T19:36:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64362024-11-25T19:36:46.858ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64372024-11-25T19:36:46.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64382024-11-25T19:36:46.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64392024-11-25T19:36:46.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
64402024-11-25T19:36:46.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64412024-11-25T19:36:46.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64422024-11-25T19:36:46.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64432024-11-25T19:36:46.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64442024-11-25T19:36:46.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64452024-11-25T19:36:46.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64462024-11-25T19:36:46.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64472024-11-25T19:36:46.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
64482024-11-25T19:36:46.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64492024-11-25T19:36:46.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64502024-11-25T19:36:46.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.993184ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64512024-11-25T19:36:46.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64522024-11-25T19:36:46.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64532024-11-25T19:36:46.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64542024-11-25T19:36:46.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64552024-11-25T19:36:46.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64562024-11-25T19:36:46.865ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1432, tv_nsec: 412124472 } })
64572024-11-25T19:36:46.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64582024-11-25T19:36:46.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64592024-11-25T19:36:46.866ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
64602024-11-25T19:36:46.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64612024-11-25T19:36:46.867ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64622024-11-25T19:36:46.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64632024-11-25T19:36:46.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64642024-11-25T19:36:46.870ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
64652024-11-25T19:36:46.870ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.8974ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
64662024-11-25T19:36:46.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64672024-11-25T19:36:46.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64682024-11-25T19:36:46.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64692024-11-25T19:36:46.883ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64702024-11-25T19:36:46.883ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
64712024-11-25T19:36:46.883ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64722024-11-25T19:36:46.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64732024-11-25T19:36:46.886ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64742024-11-25T19:36:46.886ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
64752024-11-25T19:36:46.886ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64762024-11-25T19:36:46.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64772024-11-25T19:36:46.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 39.849761ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
64782024-11-25T19:36:46.894ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64792024-11-25T19:36:46.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64802024-11-25T19:36:46.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64812024-11-25T19:36:46.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64822024-11-25T19:36:46.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64832024-11-25T19:36:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64842024-11-25T19:36:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64852024-11-25T19:36:46.902ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
64862024-11-25T19:36:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
64872024-11-25T19:36:46.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64882024-11-25T19:36:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64892024-11-25T19:36:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64902024-11-25T19:36:46.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 55.185253ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
64912024-11-25T19:36:46.904ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 55.698503ms iteration = 12 status = 0
64922024-11-25T19:36:46.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64932024-11-25T19:36:46.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
64942024-11-25T19:36:46.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64952024-11-25T19:36:46.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64962024-11-25T19:36:46.916ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 67.658197ms iteration = 14 status = {"physical_disks_added":0}
64972024-11-25T19:36:46.918ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64982024-11-25T19:36:46.918ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
64992024-11-25T19:36:46.918ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 69.33261ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
65002024-11-25T19:36:46.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 70.134156ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
65012024-11-25T19:36:46.921ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
65022024-11-25T19:36:46.921ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65032024-11-25T19:36:46.921ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88b65bdf-c90d-43a3-b84e-8884eae49667", "content-length": "26", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
65042024-11-25T19:36:46.921ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65052024-11-25T19:36:46.923ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65062024-11-25T19:36:46.927ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
65072024-11-25T19:36:46.927ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.249096ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
65082024-11-25T19:36:46.931ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
65092024-11-25T19:36:46.931ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65102024-11-25T19:36:46.931ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac08d3cd-8ec4-43f6-9ab7-5ec0a5fff5da", "content-length": "26", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
65112024-11-25T19:36:46.931ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65122024-11-25T19:36:46.933ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65132024-11-25T19:36:46.938ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65142024-11-25T19:36:46.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65152024-11-25T19:36:46.942ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 93.140667ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
65162024-11-25T19:36:46.963ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
65172024-11-25T19:36:46.963ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65182024-11-25T19:36:46.963ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "58294d43-5f15-4555-9c60-f0aa5638ba1e", "content-length": "26", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
65192024-11-25T19:36:46.963ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65202024-11-25T19:36:46.965ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
65212024-11-25T19:36:47.047ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
65222024-11-25T19:36:47.047ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b08cdd8c-d4a8-4200-b9fc-1454587baa3f", "content-length": "1", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
65232024-11-25T19:36:47.049ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65242024-11-25T19:36:47.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65252024-11-25T19:36:47.116ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 267.325515ms iteration = 12 status = {}
65262024-11-25T19:36:47.133ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
65272024-11-25T19:36:47.133ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65282024-11-25T19:36:47.133ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "01d778a2-6ac9-4741-9b1b-ba47f7aa1020", "content-length": "372", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
65292024-11-25T19:36:47.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65302024-11-25T19:36:47.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65312024-11-25T19:36:47.135ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 286.621044ms iteration = 12 status = null
65322024-11-25T19:36:47.141ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65332024-11-25T19:36:47.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65342024-11-25T19:36:47.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65352024-11-25T19:36:47.145ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65362024-11-25T19:36:47.145ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65372024-11-25T19:36:47.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65382024-11-25T19:36:47.147ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65392024-11-25T19:36:47.148ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
65402024-11-25T19:36:47.148ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
65412024-11-25T19:36:47.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7bd8bd5e-75c1-466f-9564-c121910c6f92 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
65422024-11-25T19:36:47.149ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65432024-11-25T19:36:47.149ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65442024-11-25T19:36:47.149ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9ffe2d77-7c10-4fd7-a9ab-689550acb77b", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
65452024-11-25T19:36:47.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65462024-11-25T19:36:47.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65472024-11-25T19:36:47.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7bd8bd5e-75c1-466f-9564-c121910c6f92 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
65482024-11-25T19:36:47.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65492024-11-25T19:36:47.157ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65502024-11-25T19:36:47.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65512024-11-25T19:36:47.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7bd8bd5e-75c1-466f-9564-c121910c6f92 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
65522024-11-25T19:36:47.161ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65532024-11-25T19:36:47.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65542024-11-25T19:36:47.165ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
65552024-11-25T19:36:47.165ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65562024-11-25T19:36:47.165ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "59543f4a-41f2-4e63-9eab-a455e8508ab5", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
65572024-11-25T19:36:47.168ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 319.130601ms iteration = 12 status = {}
65582024-11-25T19:36:47.189ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65592024-11-25T19:36:47.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65602024-11-25T19:36:47.200ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
65612024-11-25T19:36:47.201ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "75611950-4ee0-4c36-a302-d625211bab36", "content-length": "691", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
65622024-11-25T19:36:47.201ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
65632024-11-25T19:36:47.201ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
65642024-11-25T19:36:47.201ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
65652024-11-25T19:36:47.202ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 353.740311ms iteration = 12 status = {}
65662024-11-25T19:36:47.203ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
65672024-11-25T19:36:47.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65682024-11-25T19:36:47.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65692024-11-25T19:36:47.211ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
65702024-11-25T19:36:47.211ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1622509-473a-455d-bc0d-3a66dba0437e", "content-length": "134", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
65712024-11-25T19:36:47.211ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
65722024-11-25T19:36:47.211ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
65732024-11-25T19:36:47.212ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
65742024-11-25T19:36:47.212ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
65752024-11-25T19:36:47.212ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65762024-11-25T19:36:47.212ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65772024-11-25T19:36:47.212ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65782024-11-25T19:36:47.212ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65792024-11-25T19:36:47.212ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65802024-11-25T19:36:47.212ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65812024-11-25T19:36:47.212ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
65822024-11-25T19:36:47.212ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65832024-11-25T19:36:47.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65842024-11-25T19:36:47.214ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
65852024-11-25T19:36:47.215ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6d19fd2-9f6a-43ba-b172-ba3704e26736", "content-length": "2", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
65862024-11-25T19:36:47.215ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
65872024-11-25T19:36:47.215ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6eb7e21d-1f4e-4071-922e-31920404fe7f", "content-length": "51", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
65882024-11-25T19:36:47.215ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
65892024-11-25T19:36:47.215ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
65902024-11-25T19:36:47.310ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f5d2c8fe-7910-4dea-b247-48a41c5cc8db", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
65912024-11-25T19:36:47.310ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
65922024-11-25T19:36:47.311ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
65932024-11-25T19:36:47.311ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e28fb93-8baa-49cf-9ccf-e403a62624b7", "content-length": "682", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
65942024-11-25T19:36:47.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65952024-11-25T19:36:47.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65962024-11-25T19:36:47.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65972024-11-25T19:36:47.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65982024-11-25T19:36:47.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65992024-11-25T19:36:47.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66002024-11-25T19:36:47.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66012024-11-25T19:36:47.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66022024-11-25T19:36:47.328ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 479.07442ms iteration = 12 status = {}
66032024-11-25T19:36:47.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = a1ba4730-3d3e-4334-b891-a83d7e829cb3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
66042024-11-25T19:36:47.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = a1ba4730-3d3e-4334-b891-a83d7e829cb3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
66052024-11-25T19:36:47.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = a1ba4730-3d3e-4334-b891-a83d7e829cb3 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
66062024-11-25T19:36:48.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3ad8ae84-2470-4e12-b4a7-4bac067d9b6b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66072024-11-25T19:36:48.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3ad8ae84-2470-4e12-b4a7-4bac067d9b6b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66082024-11-25T19:36:48.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3ad8ae84-2470-4e12-b4a7-4bac067d9b6b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66092024-11-25T19:36:49.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ecd46440-29f2-4408-a8fb-620215866480 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66102024-11-25T19:36:49.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ecd46440-29f2-4408-a8fb-620215866480 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66112024-11-25T19:36:49.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ecd46440-29f2-4408-a8fb-620215866480 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66122024-11-25T19:36:50.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a3e53e8c-09b9-43ac-b7d1-71cb2380b418 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66132024-11-25T19:36:50.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a3e53e8c-09b9-43ac-b7d1-71cb2380b418 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66142024-11-25T19:36:50.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a3e53e8c-09b9-43ac-b7d1-71cb2380b418 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66152024-11-25T19:36:51.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 50ea1240-549f-4da0-89cb-261bc78b54a2 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66162024-11-25T19:36:51.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 50ea1240-549f-4da0-89cb-261bc78b54a2 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66172024-11-25T19:36:51.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 50ea1240-549f-4da0-89cb-261bc78b54a2 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66182024-11-25T19:36:52.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a3864f30-096c-4061-9dbc-0834291691ab roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66192024-11-25T19:36:52.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a3864f30-096c-4061-9dbc-0834291691ab resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66202024-11-25T19:36:52.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a3864f30-096c-4061-9dbc-0834291691ab response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66212024-11-25T19:36:52.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 551 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 1b7017f0-bc48-488f-b39f-e55c935b7969 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
66222024-11-25T19:36:53.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f1fa992c-f4c9-4747-99dc-7466bacbbebc roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66232024-11-25T19:36:53.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f1fa992c-f4c9-4747-99dc-7466bacbbebc resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66242024-11-25T19:36:53.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f1fa992c-f4c9-4747-99dc-7466bacbbebc response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66252024-11-25T19:36:54.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dfc3a7ee-55cc-4a9c-ad72-2d37752b17a3 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66262024-11-25T19:36:54.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dfc3a7ee-55cc-4a9c-ad72-2d37752b17a3 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66272024-11-25T19:36:54.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dfc3a7ee-55cc-4a9c-ad72-2d37752b17a3 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66282024-11-25T19:36:55.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c2872797-aea9-4e6e-a64f-e35b58f1a9dc roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66292024-11-25T19:36:55.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c2872797-aea9-4e6e-a64f-e35b58f1a9dc resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66302024-11-25T19:36:55.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c2872797-aea9-4e6e-a64f-e35b58f1a9dc response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66312024-11-25T19:36:56.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a99cacec-f6be-4870-a570-fb52b999b78e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66322024-11-25T19:36:56.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a99cacec-f6be-4870-a570-fb52b999b78e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66332024-11-25T19:36:56.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a99cacec-f6be-4870-a570-fb52b999b78e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66342024-11-25T19:36:56.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
66352024-11-25T19:36:56.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66362024-11-25T19:36:56.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
66372024-11-25T19:36:56.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66382024-11-25T19:36:56.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66392024-11-25T19:36:56.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66402024-11-25T19:36:56.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66412024-11-25T19:36:56.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66422024-11-25T19:36:56.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66432024-11-25T19:36:56.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.706403ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66442024-11-25T19:36:56.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66452024-11-25T19:36:56.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66462024-11-25T19:36:56.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66472024-11-25T19:36:56.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66482024-11-25T19:36:56.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66492024-11-25T19:36:56.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66502024-11-25T19:36:56.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
66512024-11-25T19:36:56.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66522024-11-25T19:36:56.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66532024-11-25T19:36:56.867ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
66542024-11-25T19:36:56.867ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.764679ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
66552024-11-25T19:36:57.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c0ed26fe-86c8-4e8b-b93f-715d5371ac28 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66562024-11-25T19:36:57.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c0ed26fe-86c8-4e8b-b93f-715d5371ac28 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66572024-11-25T19:36:57.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c0ed26fe-86c8-4e8b-b93f-715d5371ac28 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66582024-11-25T19:36:58.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d2dd728e-f4e8-49b9-8cda-a962d01723b2 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66592024-11-25T19:36:58.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d2dd728e-f4e8-49b9-8cda-a962d01723b2 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66602024-11-25T19:36:58.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d2dd728e-f4e8-49b9-8cda-a962d01723b2 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66612024-11-25T19:36:59.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 545ab010-a71b-44c1-9311-48ce2102175e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66622024-11-25T19:36:59.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 545ab010-a71b-44c1-9311-48ce2102175e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66632024-11-25T19:36:59.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 545ab010-a71b-44c1-9311-48ce2102175e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66642024-11-25T19:37:00.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bf9ccaaf-655e-4e51-89b0-124f8f6cd257 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66652024-11-25T19:37:00.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bf9ccaaf-655e-4e51-89b0-124f8f6cd257 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66662024-11-25T19:37:00.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bf9ccaaf-655e-4e51-89b0-124f8f6cd257 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66672024-11-25T19:37:01.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ae0b1d72-f7a9-4829-b688-fd8d317cb85c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66682024-11-25T19:37:01.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ae0b1d72-f7a9-4829-b688-fd8d317cb85c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66692024-11-25T19:37:01.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ae0b1d72-f7a9-4829-b688-fd8d317cb85c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66702024-11-25T19:37:02.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 544 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 37f4d932-63dc-4fcb-b4d8-4d9f4eb3d946 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
66712024-11-25T19:37:02.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5a9798e0-22bd-4419-9495-56c21345ab57 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66722024-11-25T19:37:02.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5a9798e0-22bd-4419-9495-56c21345ab57 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66732024-11-25T19:37:02.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5a9798e0-22bd-4419-9495-56c21345ab57 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66742024-11-25T19:37:03.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 134158ca-6e97-4211-9531-4b7c363b7f20 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66752024-11-25T19:37:03.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 134158ca-6e97-4211-9531-4b7c363b7f20 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66762024-11-25T19:37:03.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 134158ca-6e97-4211-9531-4b7c363b7f20 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66772024-11-25T19:37:04.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f8a72ec2-0cf0-45c8-8cf9-c4ca8645295e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66782024-11-25T19:37:04.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f8a72ec2-0cf0-45c8-8cf9-c4ca8645295e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66792024-11-25T19:37:04.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f8a72ec2-0cf0-45c8-8cf9-c4ca8645295e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66802024-11-25T19:37:05.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8f863021-7f5a-47e3-a1d2-c90dcdced15b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66812024-11-25T19:37:05.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8f863021-7f5a-47e3-a1d2-c90dcdced15b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66822024-11-25T19:37:05.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8f863021-7f5a-47e3-a1d2-c90dcdced15b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66832024-11-25T19:37:06.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3612f3e0-690e-4aad-b8b4-805b7ee83fc3 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66842024-11-25T19:37:06.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3612f3e0-690e-4aad-b8b4-805b7ee83fc3 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66852024-11-25T19:37:06.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3612f3e0-690e-4aad-b8b4-805b7ee83fc3 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
66862024-11-25T19:37:06.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
66872024-11-25T19:37:06.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
66882024-11-25T19:37:06.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66892024-11-25T19:37:06.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66902024-11-25T19:37:06.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66912024-11-25T19:37:06.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66922024-11-25T19:37:06.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66932024-11-25T19:37:06.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66942024-11-25T19:37:06.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66952024-11-25T19:37:06.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.389046ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66962024-11-25T19:37:06.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66972024-11-25T19:37:06.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66982024-11-25T19:37:06.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66992024-11-25T19:37:06.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67002024-11-25T19:37:06.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67012024-11-25T19:37:06.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67022024-11-25T19:37:06.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
67032024-11-25T19:37:06.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67042024-11-25T19:37:06.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67052024-11-25T19:37:06.868ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
67062024-11-25T19:37:06.868ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.206787ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
67072024-11-25T19:37:07.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 27a92b40-af8f-4ee9-9eda-3dd41937094d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67082024-11-25T19:37:07.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 27a92b40-af8f-4ee9-9eda-3dd41937094d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67092024-11-25T19:37:07.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 27a92b40-af8f-4ee9-9eda-3dd41937094d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67102024-11-25T19:37:08.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b18d07df-6792-472a-ab46-f28ab7c7d472 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67112024-11-25T19:37:08.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b18d07df-6792-472a-ab46-f28ab7c7d472 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67122024-11-25T19:37:08.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b18d07df-6792-472a-ab46-f28ab7c7d472 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67132024-11-25T19:37:09.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 73b0a2f0-58c9-46fa-9187-0314b8ccda7c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67142024-11-25T19:37:09.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 73b0a2f0-58c9-46fa-9187-0314b8ccda7c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67152024-11-25T19:37:09.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 73b0a2f0-58c9-46fa-9187-0314b8ccda7c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67162024-11-25T19:37:10.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fa0b1ba6-ea25-49c7-9d00-52924874469b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67172024-11-25T19:37:10.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fa0b1ba6-ea25-49c7-9d00-52924874469b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67182024-11-25T19:37:10.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fa0b1ba6-ea25-49c7-9d00-52924874469b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67192024-11-25T19:37:11.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 89d1d220-85bc-4d6f-9e17-8949509cb23c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67202024-11-25T19:37:11.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 89d1d220-85bc-4d6f-9e17-8949509cb23c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67212024-11-25T19:37:11.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 89d1d220-85bc-4d6f-9e17-8949509cb23c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67222024-11-25T19:37:12.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 692 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 3439cea3-a579-4753-b468-74d9577086e6 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
67232024-11-25T19:37:12.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a1ce8585-b24c-408a-9975-6d8e02eacd74 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67242024-11-25T19:37:12.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a1ce8585-b24c-408a-9975-6d8e02eacd74 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67252024-11-25T19:37:12.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a1ce8585-b24c-408a-9975-6d8e02eacd74 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67262024-11-25T19:37:13.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = edec5428-504f-4851-9743-b9113ac7152c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67272024-11-25T19:37:13.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = edec5428-504f-4851-9743-b9113ac7152c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67282024-11-25T19:37:13.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = edec5428-504f-4851-9743-b9113ac7152c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67292024-11-25T19:37:14.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e4b0a83d-3816-4d9e-a592-1c4ba733582d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67302024-11-25T19:37:14.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e4b0a83d-3816-4d9e-a592-1c4ba733582d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67312024-11-25T19:37:14.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e4b0a83d-3816-4d9e-a592-1c4ba733582d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67322024-11-25T19:37:15.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bf8ca76f-f6aa-4803-a761-5568afb0fc2e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67332024-11-25T19:37:15.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bf8ca76f-f6aa-4803-a761-5568afb0fc2e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67342024-11-25T19:37:15.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1664 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bf8ca76f-f6aa-4803-a761-5568afb0fc2e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67352024-11-25T19:37:16.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c73ac9ee-9a67-46ce-a58f-09343120525a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67362024-11-25T19:37:16.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c73ac9ee-9a67-46ce-a58f-09343120525a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67372024-11-25T19:37:16.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c73ac9ee-9a67-46ce-a58f-09343120525a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
67382024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
67392024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
67402024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
67412024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
67422024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67432024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67442024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67452024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
67462024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67472024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
67482024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67492024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
67502024-11-25T19:37:16.849ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:27:16.849278003 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
67512024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
67522024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
67532024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
67542024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
67552024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
67562024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67572024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67582024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
67592024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67602024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
67612024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
67622024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67632024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67642024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
67652024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
67662024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67672024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
67682024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
67692024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
67702024-11-25T19:37:16.849ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
67712024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67722024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
67732024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
67742024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
67752024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67762024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
67772024-11-25T19:37:16.849ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
67782024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.82\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
67792024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
67802024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
67812024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
67822024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
67832024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67842024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
67852024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
67862024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67872024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
67882024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
67892024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
67902024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
67912024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
67922024-11-25T19:37:16.849ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
67932024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
67942024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67952024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
67962024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
67972024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
67982024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67992024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68002024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68012024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68022024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
68032024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68042024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68052024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68062024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
68072024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68082024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
68092024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
68102024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68112024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68122024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68132024-11-25T19:37:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68142024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
68152024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68162024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
68172024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68182024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68192024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
68202024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68212024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68222024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
68232024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68242024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
68252024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68262024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68272024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68282024-11-25T19:37:16.850ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1462, tv_nsec: 396025646 } })
68292024-11-25T19:37:16.850ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1462, tv_nsec: 396025636 } })
68302024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68312024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68322024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68332024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68342024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68352024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68362024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
68372024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.105982ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
68382024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
68392024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.224215ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
68402024-11-25T19:37:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68412024-11-25T19:37:16.852ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68422024-11-25T19:37:16.853ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.044329ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
68432024-11-25T19:37:16.853ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1462, tv_nsec: 399625137 } })
68442024-11-25T19:37:16.853ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1462, tv_nsec: 399835281 } })
68452024-11-25T19:37:16.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
68462024-11-25T19:37:16.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
68472024-11-25T19:37:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
68482024-11-25T19:37:16.854ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68492024-11-25T19:37:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68502024-11-25T19:37:16.856ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:27:16.849278003 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
68512024-11-25T19:37:16.856ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.315893ms iteration = 7 status = {"expiration":"2024-11-25T19:27:16.849278003Z","pruned":[]}
68522024-11-25T19:37:16.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68532024-11-25T19:37:16.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68542024-11-25T19:37:16.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68552024-11-25T19:37:16.858ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68562024-11-25T19:37:16.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68572024-11-25T19:37:16.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68582024-11-25T19:37:16.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68592024-11-25T19:37:16.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68602024-11-25T19:37:16.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68612024-11-25T19:37:16.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68622024-11-25T19:37:16.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
68632024-11-25T19:37:16.861ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
68642024-11-25T19:37:16.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
68652024-11-25T19:37:16.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
68662024-11-25T19:37:16.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68672024-11-25T19:37:16.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68682024-11-25T19:37:16.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68692024-11-25T19:37:16.862ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68702024-11-25T19:37:16.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68712024-11-25T19:37:16.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68722024-11-25T19:37:16.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.711748ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
68732024-11-25T19:37:16.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68742024-11-25T19:37:16.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
68752024-11-25T19:37:16.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68762024-11-25T19:37:16.864ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68772024-11-25T19:37:16.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68782024-11-25T19:37:16.866ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.3234ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
68792024-11-25T19:37:16.867ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68802024-11-25T19:37:16.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
68812024-11-25T19:37:16.867ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68822024-11-25T19:37:16.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68832024-11-25T19:37:16.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68842024-11-25T19:37:16.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68852024-11-25T19:37:16.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68862024-11-25T19:37:16.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68872024-11-25T19:37:16.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68882024-11-25T19:37:16.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68892024-11-25T19:37:16.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68902024-11-25T19:37:16.869ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68912024-11-25T19:37:16.870ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68922024-11-25T19:37:16.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68932024-11-25T19:37:16.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68942024-11-25T19:37:16.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
68952024-11-25T19:37:16.872ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68962024-11-25T19:37:16.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68972024-11-25T19:37:16.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68982024-11-25T19:37:16.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
68992024-11-25T19:37:16.873ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69002024-11-25T19:37:16.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
69012024-11-25T19:37:16.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69022024-11-25T19:37:16.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69032024-11-25T19:37:16.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69042024-11-25T19:37:16.874ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69052024-11-25T19:37:16.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
69062024-11-25T19:37:16.876ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69072024-11-25T19:37:16.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69082024-11-25T19:37:16.876ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69092024-11-25T19:37:16.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69102024-11-25T19:37:16.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
69112024-11-25T19:37:16.878ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69122024-11-25T19:37:16.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69132024-11-25T19:37:16.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69142024-11-25T19:37:16.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69152024-11-25T19:37:16.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69162024-11-25T19:37:16.881ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
69172024-11-25T19:37:16.881ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
69182024-11-25T19:37:16.881ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
69192024-11-25T19:37:16.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69202024-11-25T19:37:16.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69212024-11-25T19:37:16.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69222024-11-25T19:37:16.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.665451ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69232024-11-25T19:37:16.883ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1462, tv_nsec: 429427701 } })
69242024-11-25T19:37:16.883ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
69252024-11-25T19:37:16.884ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 34.970086ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
69262024-11-25T19:37:16.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69272024-11-25T19:37:16.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69282024-11-25T19:37:16.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69292024-11-25T19:37:16.888ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69302024-11-25T19:37:16.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69312024-11-25T19:37:16.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69322024-11-25T19:37:16.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69332024-11-25T19:37:16.890ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 40.901273ms iteration = 4 status = {"nsuccess":5}
69342024-11-25T19:37:16.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69352024-11-25T19:37:16.890ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69362024-11-25T19:37:16.890ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69372024-11-25T19:37:16.891ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69382024-11-25T19:37:16.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69392024-11-25T19:37:16.891ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
69402024-11-25T19:37:16.891ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
69412024-11-25T19:37:16.891ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 41.969504ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
69422024-11-25T19:37:16.891ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69432024-11-25T19:37:16.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69442024-11-25T19:37:16.894ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69452024-11-25T19:37:16.894ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69462024-11-25T19:37:16.894ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
69472024-11-25T19:37:16.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69482024-11-25T19:37:16.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69492024-11-25T19:37:16.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
69502024-11-25T19:37:16.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69512024-11-25T19:37:16.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69522024-11-25T19:37:16.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69532024-11-25T19:37:16.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69542024-11-25T19:37:16.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69552024-11-25T19:37:16.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
69562024-11-25T19:37:16.895ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69572024-11-25T19:37:16.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69582024-11-25T19:37:16.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69592024-11-25T19:37:16.909ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
69602024-11-25T19:37:16.909ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
69612024-11-25T19:37:16.909ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69622024-11-25T19:37:16.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69632024-11-25T19:37:16.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69642024-11-25T19:37:16.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69652024-11-25T19:37:16.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69662024-11-25T19:37:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69672024-11-25T19:37:16.919ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69682024-11-25T19:37:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69692024-11-25T19:37:16.920ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
69702024-11-25T19:37:16.920ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.951003ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
69712024-11-25T19:37:16.920ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
69722024-11-25T19:37:16.920ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
69732024-11-25T19:37:16.920ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
69742024-11-25T19:37:16.920ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 71.34254ms iteration = 7 status = {"generation":2}
69752024-11-25T19:37:16.924ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
69762024-11-25T19:37:16.924ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.500372ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
69772024-11-25T19:37:16.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 76.94196ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
69782024-11-25T19:37:16.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69792024-11-25T19:37:16.929ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69802024-11-25T19:37:16.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69812024-11-25T19:37:16.930ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69822024-11-25T19:37:16.930ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69832024-11-25T19:37:16.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69842024-11-25T19:37:16.930ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.421417ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
69852024-11-25T19:37:16.932ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
69862024-11-25T19:37:16.932ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
69872024-11-25T19:37:16.932ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
69882024-11-25T19:37:16.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69892024-11-25T19:37:16.932ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69902024-11-25T19:37:16.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69912024-11-25T19:37:16.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69922024-11-25T19:37:16.933ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69932024-11-25T19:37:16.934ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69942024-11-25T19:37:16.934ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
69952024-11-25T19:37:16.934ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
69962024-11-25T19:37:16.934ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 84.802584ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
69972024-11-25T19:37:16.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
69982024-11-25T19:37:16.937ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69992024-11-25T19:37:16.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70002024-11-25T19:37:16.938ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70012024-11-25T19:37:16.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70022024-11-25T19:37:16.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70032024-11-25T19:37:16.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70042024-11-25T19:37:16.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70052024-11-25T19:37:16.939ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.851183ms iteration = 13 status = 0
70062024-11-25T19:37:16.940ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 90.843953ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
70072024-11-25T19:37:16.948ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
70082024-11-25T19:37:16.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
70092024-11-25T19:37:16.951ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70102024-11-25T19:37:16.951ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70112024-11-25T19:37:16.951ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70122024-11-25T19:37:16.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70132024-11-25T19:37:16.957ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70142024-11-25T19:37:16.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70152024-11-25T19:37:16.958ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70162024-11-25T19:37:16.961ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
70172024-11-25T19:37:16.961ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70182024-11-25T19:37:16.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70192024-11-25T19:37:16.962ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 112.995397ms iteration = 15 status = {"physical_disks_added":0}
70202024-11-25T19:37:16.970ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
70212024-11-25T19:37:16.970ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 120.82455ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
70222024-11-25T19:37:16.974ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
70232024-11-25T19:37:16.974ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
70242024-11-25T19:37:16.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70252024-11-25T19:37:16.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70262024-11-25T19:37:16.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70272024-11-25T19:37:16.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70282024-11-25T19:37:16.980ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70292024-11-25T19:37:16.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70302024-11-25T19:37:16.987ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
70312024-11-25T19:37:16.987ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
70322024-11-25T19:37:16.987ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
70332024-11-25T19:37:16.987ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 138.053389ms iteration = 7 status = {"generation":1}
70342024-11-25T19:37:16.988ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
70352024-11-25T19:37:16.990ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70362024-11-25T19:37:16.990ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
70372024-11-25T19:37:16.990ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.913764ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
70382024-11-25T19:37:17.006ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70392024-11-25T19:37:17.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70402024-11-25T19:37:17.007ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
70412024-11-25T19:37:17.007ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70422024-11-25T19:37:17.007ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b797aad-29e2-459d-ac2b-52d9a37d2cdd", "content-length": "26", "date": "Mon, 25 Nov 2024 19:37:17 GMT"} })
70432024-11-25T19:37:17.007ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70442024-11-25T19:37:17.008ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70452024-11-25T19:37:17.009ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70462024-11-25T19:37:17.010ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70472024-11-25T19:37:17.010ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70482024-11-25T19:37:17.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70492024-11-25T19:37:17.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70502024-11-25T19:37:17.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70512024-11-25T19:37:17.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70522024-11-25T19:37:17.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70532024-11-25T19:37:17.029ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
70542024-11-25T19:37:17.029ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70552024-11-25T19:37:17.030ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a61735b-668a-4644-88a5-959165e5784d", "content-length": "26", "date": "Mon, 25 Nov 2024 19:37:17 GMT"} })
70562024-11-25T19:37:17.030ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70572024-11-25T19:37:17.031ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70582024-11-25T19:37:17.047ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
70592024-11-25T19:37:17.047ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 198.160658ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
70602024-11-25T19:37:17.081ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
70612024-11-25T19:37:17.210ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
70622024-11-25T19:37:17.210ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "576c3aa2-b23a-40f7-8bab-dee3a6d14752", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70632024-11-25T19:37:17.210ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70642024-11-25T19:37:17.212ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c53bf719-cb66-43be-86dc-3a5eff1d8122", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70652024-11-25T19:37:17.212ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70662024-11-25T19:37:17.214ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70672024-11-25T19:37:17.214ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 364.564542ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
70682024-11-25T19:37:17.226ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
70692024-11-25T19:37:17.226ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70702024-11-25T19:37:17.226ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "85c33a06-a00d-4c05-80e7-74cbfbdd5867", "content-length": "372", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
70712024-11-25T19:37:17.227ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70722024-11-25T19:37:17.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70732024-11-25T19:37:17.237ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
70742024-11-25T19:37:17.237ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70752024-11-25T19:37:17.237ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab1ce6c8-1ec9-48f9-9886-13cfeeba6ecb", "content-length": "26", "date": "Mon, 25 Nov 2024 19:37:17 GMT"} })
70762024-11-25T19:37:17.237ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70772024-11-25T19:37:17.239ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
70782024-11-25T19:37:17.239ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
70792024-11-25T19:37:17.240ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a639bb4e-addd-4b29-b858-73465ddb7dce", "content-length": "691", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
70802024-11-25T19:37:17.240ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
70812024-11-25T19:37:17.240ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
70822024-11-25T19:37:17.240ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
70832024-11-25T19:37:17.241ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 391.837697ms iteration = 13 status = {}
70842024-11-25T19:37:17.242ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
70852024-11-25T19:37:17.242ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
70862024-11-25T19:37:17.242ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "486777d9-095f-4abb-8a06-21e3ee49ddfd", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
70872024-11-25T19:37:17.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70882024-11-25T19:37:17.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70892024-11-25T19:37:17.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70902024-11-25T19:37:17.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70912024-11-25T19:37:17.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70922024-11-25T19:37:17.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70932024-11-25T19:37:17.251ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
70942024-11-25T19:37:17.251ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70952024-11-25T19:37:17.252ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "36e22470-733d-4d5d-bd91-43a92ab3b315", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
70962024-11-25T19:37:17.254ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 404.443065ms iteration = 13 status = {}
70972024-11-25T19:37:17.302ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
70982024-11-25T19:37:17.310ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 460.981335ms iteration = 13 status = {}
70992024-11-25T19:37:17.328ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
71002024-11-25T19:37:17.328ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1befefbe-3e4b-4d9d-a0ef-79fa9eff435c", "content-length": "1", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
71012024-11-25T19:37:17.330ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71022024-11-25T19:37:17.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71032024-11-25T19:37:17.333ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 483.845963ms iteration = 13 status = null
71042024-11-25T19:37:17.372ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
71052024-11-25T19:37:17.373ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ba3794d7-a544-4196-a535-1d8322b0a9f8", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
71062024-11-25T19:37:17.373ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
71072024-11-25T19:37:17.374ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6384a8e5-89e0-4a66-bbe6-af952d3eb02b", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
71082024-11-25T19:37:17.374ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
71092024-11-25T19:37:17.376ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a70556eb-c670-4bf5-a3d4-7e5cd326f19d", "date": "Mon, 25 Nov 2024 19:37:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
71102024-11-25T19:37:17.376ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
71112024-11-25T19:37:17.378ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
71122024-11-25T19:37:17.378ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 529.132901ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
71132024-11-25T19:37:17.402ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
71142024-11-25T19:37:17.402ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
71152024-11-25T19:37:17.425ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71162024-11-25T19:37:17.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71172024-11-25T19:37:17.427ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
71182024-11-25T19:37:17.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71192024-11-25T19:37:17.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71202024-11-25T19:37:17.435ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
71212024-11-25T19:37:17.435ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "94e5ed80-0acd-4753-8caa-d1c9ce6fbac0", "content-length": "134", "date": "Mon, 25 Nov 2024 19:37:17 GMT"} })
71222024-11-25T19:37:17.435ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
71232024-11-25T19:37:17.435ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
71242024-11-25T19:37:17.435ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
71252024-11-25T19:37:17.435ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
71262024-11-25T19:37:17.435ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71272024-11-25T19:37:17.435ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71282024-11-25T19:37:17.435ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71292024-11-25T19:37:17.436ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71302024-11-25T19:37:17.436ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71312024-11-25T19:37:17.436ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71322024-11-25T19:37:17.436ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
71332024-11-25T19:37:17.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71342024-11-25T19:37:17.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71352024-11-25T19:37:17.437ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
71362024-11-25T19:37:17.437ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:33807
71372024-11-25T19:37:17.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:33807 req_id = 46ea1f01-b153-4e7f-839a-ffb662693ab6 roles = RoleSet { roles: {} } uri = /metrics/producers
71382024-11-25T19:37:17.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:33807 req_id = 46ea1f01-b153-4e7f-839a-ffb662693ab6 resource = Database result = Ok(()) uri = /metrics/producers
71392024-11-25T19:37:17.438ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
71402024-11-25T19:37:17.438ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9bf37ed-bdd9-465b-ac15-7d0fda7e9430", "content-length": "2", "date": "Mon, 25 Nov 2024 19:37:17 GMT"} })
71412024-11-25T19:37:17.438ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
71422024-11-25T19:37:17.438ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ca72445-f4ca-4b62-9b64-d3fae42d8886", "content-length": "51", "date": "Mon, 25 Nov 2024 19:37:17 GMT"} })
71432024-11-25T19:37:17.439ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
71442024-11-25T19:37:17.439ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
71452024-11-25T19:37:17.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 5b50ef69-63ed-4010-8ed8-6dbc09d2c5df roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
71462024-11-25T19:37:17.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 5b50ef69-63ed-4010-8ed8-6dbc09d2c5df resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
71472024-11-25T19:37:17.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 5b50ef69-63ed-4010-8ed8-6dbc09d2c5df response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
71482024-11-25T19:37:17.472ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
71492024-11-25T19:37:17.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35372 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:33807 req_id = 46ea1f01-b153-4e7f-839a-ffb662693ab6 response_code = 201 uri = /metrics/producers
71502024-11-25T19:37:17.472ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "46ea1f01-b153-4e7f-839a-ffb662693ab6", "content-length": "41", "date": "Mon, 25 Nov 2024 19:37:17 GMT"} })
71512024-11-25T19:37:17.473ZDEBGnexus (producer-registration-task): registered with nexus successfully
71522024-11-25T19:37:17.473ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
71532024-11-25T19:37:17.534ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2527e4ca-d3b7-48fd-868d-a97e94feda51", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
71542024-11-25T19:37:17.534ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
71552024-11-25T19:37:17.534ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
71562024-11-25T19:37:17.534ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "26c8ec03-419e-4a5d-a90f-8bdc3cb14055", "content-length": "682", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
71572024-11-25T19:37:17.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71582024-11-25T19:37:17.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71592024-11-25T19:37:17.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71602024-11-25T19:37:17.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71612024-11-25T19:37:17.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71622024-11-25T19:37:17.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71632024-11-25T19:37:17.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71642024-11-25T19:37:17.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71652024-11-25T19:37:17.551ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 702.478113ms iteration = 13 status = {}
71662024-11-25T19:37:17.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1c2e720b-dde6-492e-9e17-b1877ca76c5c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71672024-11-25T19:37:17.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1c2e720b-dde6-492e-9e17-b1877ca76c5c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71682024-11-25T19:37:17.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1c2e720b-dde6-492e-9e17-b1877ca76c5c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71692024-11-25T19:37:18.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2d896fab-fa47-49f2-9b87-d89969be57b6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71702024-11-25T19:37:18.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2d896fab-fa47-49f2-9b87-d89969be57b6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71712024-11-25T19:37:18.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2d896fab-fa47-49f2-9b87-d89969be57b6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71722024-11-25T19:37:19.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bcf5621f-1502-4d3f-bb0a-5a5ae1abead0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71732024-11-25T19:37:19.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bcf5621f-1502-4d3f-bb0a-5a5ae1abead0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71742024-11-25T19:37:19.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bcf5621f-1502-4d3f-bb0a-5a5ae1abead0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71752024-11-25T19:37:20.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 85d8067e-1b34-4a05-8a4e-9943616e289e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71762024-11-25T19:37:20.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 85d8067e-1b34-4a05-8a4e-9943616e289e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71772024-11-25T19:37:20.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 85d8067e-1b34-4a05-8a4e-9943616e289e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71782024-11-25T19:37:21.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 834c155c-1158-4614-8036-257e2897c7f4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71792024-11-25T19:37:21.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 834c155c-1158-4614-8036-257e2897c7f4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71802024-11-25T19:37:21.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 834c155c-1158-4614-8036-257e2897c7f4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71812024-11-25T19:37:22.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = d38c6236-2e18-4b99-afee-346147aeec88 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
71822024-11-25T19:37:22.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = d38c6236-2e18-4b99-afee-346147aeec88 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
71832024-11-25T19:37:22.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = d38c6236-2e18-4b99-afee-346147aeec88 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
71842024-11-25T19:37:22.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 890a421d-1457-4516-9b05-bbc9153e0428 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
71852024-11-25T19:37:22.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 890a421d-1457-4516-9b05-bbc9153e0428 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
71862024-11-25T19:37:22.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 890a421d-1457-4516-9b05-bbc9153e0428 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
71872024-11-25T19:37:22.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 427 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 6b114ecb-caa7-4072-9c71-f2990df9436f response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
71882024-11-25T19:37:22.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5649a27-2be5-4bc7-99eb-c5e24ca702a6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71892024-11-25T19:37:22.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5649a27-2be5-4bc7-99eb-c5e24ca702a6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71902024-11-25T19:37:22.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5649a27-2be5-4bc7-99eb-c5e24ca702a6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71912024-11-25T19:37:23.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9ded830d-8e73-4ac2-aa01-e43e21e60d23 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71922024-11-25T19:37:23.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9ded830d-8e73-4ac2-aa01-e43e21e60d23 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71932024-11-25T19:37:23.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9ded830d-8e73-4ac2-aa01-e43e21e60d23 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71942024-11-25T19:37:24.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5124db73-5e29-4f39-9094-2bdcf1e70935 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71952024-11-25T19:37:24.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5124db73-5e29-4f39-9094-2bdcf1e70935 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71962024-11-25T19:37:24.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5124db73-5e29-4f39-9094-2bdcf1e70935 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71972024-11-25T19:37:25.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 60255f66-f62a-4084-ab67-4521d10aeae0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71982024-11-25T19:37:25.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 60255f66-f62a-4084-ab67-4521d10aeae0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
71992024-11-25T19:37:25.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 60255f66-f62a-4084-ab67-4521d10aeae0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72002024-11-25T19:37:26.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
72012024-11-25T19:37:26.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
72022024-11-25T19:37:26.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72032024-11-25T19:37:26.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72042024-11-25T19:37:26.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72052024-11-25T19:37:26.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72062024-11-25T19:37:26.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72072024-11-25T19:37:26.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72082024-11-25T19:37:26.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72092024-11-25T19:37:26.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.264764ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72102024-11-25T19:37:26.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72112024-11-25T19:37:26.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72122024-11-25T19:37:26.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72132024-11-25T19:37:26.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72142024-11-25T19:37:26.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72152024-11-25T19:37:26.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72162024-11-25T19:37:26.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
72172024-11-25T19:37:26.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72182024-11-25T19:37:26.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72192024-11-25T19:37:26.870ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
72202024-11-25T19:37:26.870ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.155495ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
72212024-11-25T19:37:26.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c2cc22c9-0d53-4d5d-969d-79c7ee0266da roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72222024-11-25T19:37:26.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c2cc22c9-0d53-4d5d-969d-79c7ee0266da resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72232024-11-25T19:37:26.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c2cc22c9-0d53-4d5d-969d-79c7ee0266da response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72242024-11-25T19:37:28.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3616a2e0-dae6-40e3-b990-0b1d21c208a6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72252024-11-25T19:37:28.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3616a2e0-dae6-40e3-b990-0b1d21c208a6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72262024-11-25T19:37:28.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3616a2e0-dae6-40e3-b990-0b1d21c208a6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72272024-11-25T19:37:29.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 87a1e487-3743-4de7-b0c1-75c2bc636fa5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72282024-11-25T19:37:29.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 87a1e487-3743-4de7-b0c1-75c2bc636fa5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72292024-11-25T19:37:29.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 87a1e487-3743-4de7-b0c1-75c2bc636fa5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72302024-11-25T19:37:30.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 50393141-af95-445d-812d-57bd24745a48 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72312024-11-25T19:37:30.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 50393141-af95-445d-812d-57bd24745a48 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72322024-11-25T19:37:30.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 50393141-af95-445d-812d-57bd24745a48 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72332024-11-25T19:37:31.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 30bc6cc1-ed5f-4bd8-8d50-05057b5a1567 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72342024-11-25T19:37:31.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 30bc6cc1-ed5f-4bd8-8d50-05057b5a1567 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72352024-11-25T19:37:31.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 30bc6cc1-ed5f-4bd8-8d50-05057b5a1567 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72362024-11-25T19:37:32.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3be57231-5fc5-4d21-9bce-defce58c6f31 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72372024-11-25T19:37:32.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3be57231-5fc5-4d21-9bce-defce58c6f31 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72382024-11-25T19:37:32.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3be57231-5fc5-4d21-9bce-defce58c6f31 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72392024-11-25T19:37:32.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 566 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 37c18f01-3ea7-445c-b826-ccb99d42e380 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
72402024-11-25T19:37:33.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3189614a-1af5-44b7-894c-cfaaa290966f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72412024-11-25T19:37:33.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3189614a-1af5-44b7-894c-cfaaa290966f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72422024-11-25T19:37:33.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3189614a-1af5-44b7-894c-cfaaa290966f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72432024-11-25T19:37:34.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 029eeeb5-9a60-4c2d-a8c7-1db73cb778a8 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72442024-11-25T19:37:34.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 029eeeb5-9a60-4c2d-a8c7-1db73cb778a8 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72452024-11-25T19:37:34.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 029eeeb5-9a60-4c2d-a8c7-1db73cb778a8 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72462024-11-25T19:37:35.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 76e31a49-8cb3-40e4-be1c-cb3cf174febc roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72472024-11-25T19:37:35.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 76e31a49-8cb3-40e4-be1c-cb3cf174febc resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72482024-11-25T19:37:35.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 76e31a49-8cb3-40e4-be1c-cb3cf174febc response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72492024-11-25T19:37:36.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f0cfc018-fa62-4e3c-9a8e-209300e23f61 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72502024-11-25T19:37:36.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f0cfc018-fa62-4e3c-9a8e-209300e23f61 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72512024-11-25T19:37:36.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f0cfc018-fa62-4e3c-9a8e-209300e23f61 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72522024-11-25T19:37:36.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
72532024-11-25T19:37:36.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
72542024-11-25T19:37:36.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72552024-11-25T19:37:36.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72562024-11-25T19:37:36.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72572024-11-25T19:37:36.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72582024-11-25T19:37:36.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72592024-11-25T19:37:36.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72602024-11-25T19:37:36.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72612024-11-25T19:37:36.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72622024-11-25T19:37:36.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72632024-11-25T19:37:36.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72642024-11-25T19:37:36.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72652024-11-25T19:37:36.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72662024-11-25T19:37:36.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72672024-11-25T19:37:36.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
72682024-11-25T19:37:36.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72692024-11-25T19:37:36.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72702024-11-25T19:37:36.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
72712024-11-25T19:37:36.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.749747ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
72722024-11-25T19:37:36.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.999737ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72732024-11-25T19:37:37.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 212eb072-32b8-4798-ba6a-d6602e61ed4a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72742024-11-25T19:37:37.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 212eb072-32b8-4798-ba6a-d6602e61ed4a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72752024-11-25T19:37:37.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 212eb072-32b8-4798-ba6a-d6602e61ed4a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72762024-11-25T19:37:38.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e6aef25a-4d62-466a-81d2-50efe7a7c86b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72772024-11-25T19:37:38.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e6aef25a-4d62-466a-81d2-50efe7a7c86b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72782024-11-25T19:37:38.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e6aef25a-4d62-466a-81d2-50efe7a7c86b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72792024-11-25T19:37:39.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 968f3868-6a0e-4acf-8b7b-7581cf6a1708 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72802024-11-25T19:37:39.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 968f3868-6a0e-4acf-8b7b-7581cf6a1708 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72812024-11-25T19:37:39.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 968f3868-6a0e-4acf-8b7b-7581cf6a1708 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72822024-11-25T19:37:40.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a73c699e-3fb3-47b3-b033-ae62dfb95e82 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72832024-11-25T19:37:40.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a73c699e-3fb3-47b3-b033-ae62dfb95e82 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72842024-11-25T19:37:40.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a73c699e-3fb3-47b3-b033-ae62dfb95e82 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72852024-11-25T19:37:41.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d0b194af-0875-4319-973f-ff0e60fa3a3d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72862024-11-25T19:37:41.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d0b194af-0875-4319-973f-ff0e60fa3a3d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72872024-11-25T19:37:41.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d0b194af-0875-4319-973f-ff0e60fa3a3d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72882024-11-25T19:37:42.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 605 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 6b5d64b7-0bfd-4380-99b6-bf440c549370 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
72892024-11-25T19:37:42.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 67c3d725-8a8d-47fe-bdfa-62e14a4e75fc roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72902024-11-25T19:37:42.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 67c3d725-8a8d-47fe-bdfa-62e14a4e75fc resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72912024-11-25T19:37:42.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2541 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 67c3d725-8a8d-47fe-bdfa-62e14a4e75fc response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72922024-11-25T19:37:43.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0c54d7a7-165f-4aa7-a936-bf26727d7fff roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72932024-11-25T19:37:43.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0c54d7a7-165f-4aa7-a936-bf26727d7fff resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72942024-11-25T19:37:43.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0c54d7a7-165f-4aa7-a936-bf26727d7fff response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72952024-11-25T19:37:44.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ab8866a9-1482-4703-b898-8562eb5a4654 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72962024-11-25T19:37:44.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ab8866a9-1482-4703-b898-8562eb5a4654 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72972024-11-25T19:37:44.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ab8866a9-1482-4703-b898-8562eb5a4654 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72982024-11-25T19:37:45.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c350cd13-acb1-49e6-9a04-718b55809e48 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
72992024-11-25T19:37:45.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c350cd13-acb1-49e6-9a04-718b55809e48 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
73002024-11-25T19:37:45.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c350cd13-acb1-49e6-9a04-718b55809e48 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
73012024-11-25T19:37:46.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = de96b57e-412c-4fca-87a4-7ad59bb65a0c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
73022024-11-25T19:37:46.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = de96b57e-412c-4fca-87a4-7ad59bb65a0c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
73032024-11-25T19:37:46.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = de96b57e-412c-4fca-87a4-7ad59bb65a0c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
73042024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
73052024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
73062024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
73072024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73082024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
73092024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
73102024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73112024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
73122024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73132024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
73142024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73152024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
73162024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
73172024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
73182024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73192024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
73202024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
73212024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73222024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
73232024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
73242024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73252024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73262024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
73272024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73282024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
73292024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
73302024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
73312024-11-25T19:37:46.849ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
73322024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73332024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
73342024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
73352024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73362024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73372024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
73382024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73392024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
73402024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73412024-11-25T19:37:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73422024-11-25T19:37:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73432024-11-25T19:37:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73442024-11-25T19:37:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73452024-11-25T19:37:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73462024-11-25T19:37:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73472024-11-25T19:37:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
73482024-11-25T19:37:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73492024-11-25T19:37:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73502024-11-25T19:37:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
73512024-11-25T19:37:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73522024-11-25T19:37:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73532024-11-25T19:37:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73542024-11-25T19:37:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73552024-11-25T19:37:46.852ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.337995ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
73562024-11-25T19:37:46.852ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1492, tv_nsec: 398562236 } })
73572024-11-25T19:37:46.852ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1492, tv_nsec: 398596247 } })
73582024-11-25T19:37:46.853ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
73592024-11-25T19:37:46.853ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
73602024-11-25T19:37:46.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73612024-11-25T19:37:46.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73622024-11-25T19:37:46.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73632024-11-25T19:37:46.854ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73642024-11-25T19:37:46.854ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
73652024-11-25T19:37:46.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73662024-11-25T19:37:46.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73672024-11-25T19:37:46.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73682024-11-25T19:37:46.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73692024-11-25T19:37:46.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73702024-11-25T19:37:46.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
73712024-11-25T19:37:46.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73722024-11-25T19:37:46.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73732024-11-25T19:37:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73742024-11-25T19:37:46.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73752024-11-25T19:37:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73762024-11-25T19:37:46.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
73772024-11-25T19:37:46.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73782024-11-25T19:37:46.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73792024-11-25T19:37:46.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73802024-11-25T19:37:46.858ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73812024-11-25T19:37:46.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73822024-11-25T19:37:46.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73832024-11-25T19:37:46.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.027676ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
73842024-11-25T19:37:46.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73852024-11-25T19:37:46.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73862024-11-25T19:37:46.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73872024-11-25T19:37:46.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73882024-11-25T19:37:46.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
73892024-11-25T19:37:46.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73902024-11-25T19:37:46.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73912024-11-25T19:37:46.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73922024-11-25T19:37:46.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73932024-11-25T19:37:46.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73942024-11-25T19:37:46.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73952024-11-25T19:37:46.867ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1492, tv_nsec: 412893927 } })
73962024-11-25T19:37:46.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73972024-11-25T19:37:46.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73982024-11-25T19:37:46.867ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
73992024-11-25T19:37:46.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74002024-11-25T19:37:46.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74012024-11-25T19:37:46.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74022024-11-25T19:37:46.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74032024-11-25T19:37:46.870ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
74042024-11-25T19:37:46.870ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.804398ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
74052024-11-25T19:37:46.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74062024-11-25T19:37:46.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
74072024-11-25T19:37:46.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74082024-11-25T19:37:46.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74092024-11-25T19:37:46.885ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74102024-11-25T19:37:46.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74112024-11-25T19:37:46.889ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
74122024-11-25T19:37:46.889ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 39.667899ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
74132024-11-25T19:37:46.890ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 40.948453ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
74142024-11-25T19:37:46.890ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74152024-11-25T19:37:46.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74162024-11-25T19:37:46.894ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74172024-11-25T19:37:46.894ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74182024-11-25T19:37:46.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74192024-11-25T19:37:46.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74202024-11-25T19:37:46.896ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74212024-11-25T19:37:46.896ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
74222024-11-25T19:37:46.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74232024-11-25T19:37:46.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74242024-11-25T19:37:46.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 49.476891ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74252024-11-25T19:37:46.899ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74262024-11-25T19:37:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74272024-11-25T19:37:46.901ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74282024-11-25T19:37:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74292024-11-25T19:37:46.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74302024-11-25T19:37:46.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74312024-11-25T19:37:46.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.381242ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
74322024-11-25T19:37:46.957ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
74332024-11-25T19:37:46.957ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74342024-11-25T19:37:46.957ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ee4c794-f749-4c68-ac38-1eeb7777ab38", "content-length": "26", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
74352024-11-25T19:37:46.957ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74362024-11-25T19:37:46.959ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74372024-11-25T19:37:46.989ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
74382024-11-25T19:37:46.989ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74392024-11-25T19:37:46.989ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe77862a-b2d0-4158-9452-7e6159ca2f25", "content-length": "372", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
74402024-11-25T19:37:46.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74412024-11-25T19:37:46.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74422024-11-25T19:37:46.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74432024-11-25T19:37:46.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74442024-11-25T19:37:46.992ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74452024-11-25T19:37:46.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74462024-11-25T19:37:46.994ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74472024-11-25T19:37:46.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
74482024-11-25T19:37:46.997ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74492024-11-25T19:37:46.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74502024-11-25T19:37:46.998ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 149.509413ms iteration = 14 status = 0
74512024-11-25T19:37:47.021ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74522024-11-25T19:37:47.021ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
74532024-11-25T19:37:47.021ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 172.7922ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
74542024-11-25T19:37:47.022ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 173.125237ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
74552024-11-25T19:37:47.030ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 180.522122ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
74562024-11-25T19:37:47.034ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
74572024-11-25T19:37:47.034ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74582024-11-25T19:37:47.034ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc3ab84c-57fc-448c-b0d1-1be2ab0cd905", "content-length": "26", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
74592024-11-25T19:37:47.034ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74602024-11-25T19:37:47.036ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74612024-11-25T19:37:47.040ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
74622024-11-25T19:37:47.040ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
74632024-11-25T19:37:47.040ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "11ab8e38-b8b9-4578-b860-8853d3e1a0ee", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
74642024-11-25T19:37:47.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74652024-11-25T19:37:47.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74662024-11-25T19:37:47.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74672024-11-25T19:37:47.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74682024-11-25T19:37:47.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74692024-11-25T19:37:47.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74702024-11-25T19:37:47.049ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
74712024-11-25T19:37:47.049ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "693b338b-ae88-48a2-97ff-546be0bc346e", "content-length": "1", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
74722024-11-25T19:37:47.049ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
74732024-11-25T19:37:47.049ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74742024-11-25T19:37:47.050ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "af3276bf-eace-44d9-b84b-78be9f8c7967", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
74752024-11-25T19:37:47.050ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74762024-11-25T19:37:47.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74772024-11-25T19:37:47.051ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 202.33368ms iteration = 14 status = {}
74782024-11-25T19:37:47.053ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 204.234807ms iteration = 14 status = null
74792024-11-25T19:37:47.066ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
74802024-11-25T19:37:47.066ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74812024-11-25T19:37:47.066ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "11ccdc53-0865-483c-9774-f315e4d354ad", "content-length": "26", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
74822024-11-25T19:37:47.066ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74832024-11-25T19:37:47.068ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
74842024-11-25T19:37:47.102ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 253.028384ms iteration = 16 status = {"physical_disks_added":0}
74852024-11-25T19:37:47.113ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 264.415208ms iteration = 14 status = {}
74862024-11-25T19:37:47.115ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74872024-11-25T19:37:47.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74882024-11-25T19:37:47.117ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74892024-11-25T19:37:47.118ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74902024-11-25T19:37:47.118ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74912024-11-25T19:37:47.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74922024-11-25T19:37:47.120ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74932024-11-25T19:37:47.122ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74942024-11-25T19:37:47.122ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74952024-11-25T19:37:47.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74962024-11-25T19:37:47.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74972024-11-25T19:37:47.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74982024-11-25T19:37:47.204ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
74992024-11-25T19:37:47.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75002024-11-25T19:37:47.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75012024-11-25T19:37:47.213ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
75022024-11-25T19:37:47.213ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "550969fa-a54a-4698-a6a1-4793355a32af", "content-length": "134", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
75032024-11-25T19:37:47.213ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
75042024-11-25T19:37:47.213ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
75052024-11-25T19:37:47.214ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
75062024-11-25T19:37:47.214ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
75072024-11-25T19:37:47.214ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75082024-11-25T19:37:47.214ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75092024-11-25T19:37:47.214ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75102024-11-25T19:37:47.214ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75112024-11-25T19:37:47.214ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75122024-11-25T19:37:47.214ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75132024-11-25T19:37:47.214ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
75142024-11-25T19:37:47.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75152024-11-25T19:37:47.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75162024-11-25T19:37:47.217ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
75172024-11-25T19:37:47.217ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c263fe7a-3da8-485d-b647-f4480e6ba791", "content-length": "2", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
75182024-11-25T19:37:47.217ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
75192024-11-25T19:37:47.217ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "092460e2-6763-405c-acb7-991328535f8b", "content-length": "51", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
75202024-11-25T19:37:47.217ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
75212024-11-25T19:37:47.217ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
75222024-11-25T19:37:47.222ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
75232024-11-25T19:37:47.304ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ac74eaea-c8d9-43f3-a5ce-6a4419f00f50", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
75242024-11-25T19:37:47.304ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
75252024-11-25T19:37:47.304ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
75262024-11-25T19:37:47.305ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0c915ac-a9c0-44c5-ad74-03cd6e01f910", "content-length": "682", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
75272024-11-25T19:37:47.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75282024-11-25T19:37:47.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75292024-11-25T19:37:47.305ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fe33dee-18a6-4587-95ea-a2fc3c40fea3", "content-length": "691", "date": "Mon, 25 Nov 2024 19:37:47 GMT"} })
75302024-11-25T19:37:47.305ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
75312024-11-25T19:37:47.305ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
75322024-11-25T19:37:47.305ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
75332024-11-25T19:37:47.306ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 457.404534ms iteration = 14 status = {}
75342024-11-25T19:37:47.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75352024-11-25T19:37:47.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75362024-11-25T19:37:47.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75372024-11-25T19:37:47.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75382024-11-25T19:37:47.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75392024-11-25T19:37:47.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75402024-11-25T19:37:47.323ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 474.080021ms iteration = 14 status = {}
75412024-11-25T19:37:47.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 88a01585-a931-4b68-858c-0f0f27f0e68e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75422024-11-25T19:37:47.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 88a01585-a931-4b68-858c-0f0f27f0e68e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75432024-11-25T19:37:47.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2719 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 88a01585-a931-4b68-858c-0f0f27f0e68e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75442024-11-25T19:37:47.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 4861fae5-58c6-425a-8241-30e65136939b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
75452024-11-25T19:37:47.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 4861fae5-58c6-425a-8241-30e65136939b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
75462024-11-25T19:37:47.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 4861fae5-58c6-425a-8241-30e65136939b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
75472024-11-25T19:37:48.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fef23e43-054d-4956-a70c-3ea14a95868e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75482024-11-25T19:37:48.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fef23e43-054d-4956-a70c-3ea14a95868e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75492024-11-25T19:37:48.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1741 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fef23e43-054d-4956-a70c-3ea14a95868e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75502024-11-25T19:37:49.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3e7fdfa1-b3c6-4b54-a038-ff3743ae6af5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75512024-11-25T19:37:49.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3e7fdfa1-b3c6-4b54-a038-ff3743ae6af5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75522024-11-25T19:37:49.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3e7fdfa1-b3c6-4b54-a038-ff3743ae6af5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75532024-11-25T19:37:50.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a2c2a8a0-fbea-437d-a40e-861437094123 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75542024-11-25T19:37:50.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a2c2a8a0-fbea-437d-a40e-861437094123 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75552024-11-25T19:37:50.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a2c2a8a0-fbea-437d-a40e-861437094123 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75562024-11-25T19:37:51.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9d6304a8-9c09-4ef8-9db6-4c6790569b09 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75572024-11-25T19:37:51.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9d6304a8-9c09-4ef8-9db6-4c6790569b09 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75582024-11-25T19:37:51.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9d6304a8-9c09-4ef8-9db6-4c6790569b09 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75592024-11-25T19:37:52.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 99a805b0-98fc-4cf7-9c80-d25d9e2fee1c roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
75602024-11-25T19:37:52.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 99a805b0-98fc-4cf7-9c80-d25d9e2fee1c resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
75612024-11-25T19:37:52.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 99a805b0-98fc-4cf7-9c80-d25d9e2fee1c response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
75622024-11-25T19:37:52.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = b718d92f-d01c-430e-8622-12bc4f26badc roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
75632024-11-25T19:37:52.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = b718d92f-d01c-430e-8622-12bc4f26badc resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
75642024-11-25T19:37:52.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2775 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = b718d92f-d01c-430e-8622-12bc4f26badc response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
75652024-11-25T19:37:52.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 606 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 9da29b19-7ca1-4a9b-bd48-2deccdcab087 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
75662024-11-25T19:37:52.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5832fd46-0a9b-408c-932d-dc16f53498ca roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75672024-11-25T19:37:52.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5832fd46-0a9b-408c-932d-dc16f53498ca resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75682024-11-25T19:37:52.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5832fd46-0a9b-408c-932d-dc16f53498ca response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75692024-11-25T19:37:53.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 09af6117-fa47-4b2b-8d13-2f99c6916661 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75702024-11-25T19:37:53.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 09af6117-fa47-4b2b-8d13-2f99c6916661 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75712024-11-25T19:37:53.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 09af6117-fa47-4b2b-8d13-2f99c6916661 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75722024-11-25T19:37:54.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = faa86c81-7715-4839-ad29-bf2fbc6683b8 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75732024-11-25T19:37:54.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = faa86c81-7715-4839-ad29-bf2fbc6683b8 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75742024-11-25T19:37:54.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2649 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = faa86c81-7715-4839-ad29-bf2fbc6683b8 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75752024-11-25T19:37:55.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 65a0995f-15e5-4aac-bc3c-5a5bbf996551 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75762024-11-25T19:37:55.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 65a0995f-15e5-4aac-bc3c-5a5bbf996551 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75772024-11-25T19:37:55.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2851 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 65a0995f-15e5-4aac-bc3c-5a5bbf996551 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75782024-11-25T19:37:56.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bea65a5b-8fa6-4a20-a650-d39d1143f9e0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75792024-11-25T19:37:56.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bea65a5b-8fa6-4a20-a650-d39d1143f9e0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75802024-11-25T19:37:56.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bea65a5b-8fa6-4a20-a650-d39d1143f9e0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
75812024-11-25T19:37:56.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
75822024-11-25T19:37:56.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
75832024-11-25T19:37:56.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75842024-11-25T19:37:56.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75852024-11-25T19:37:56.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75862024-11-25T19:37:56.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75872024-11-25T19:37:56.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75882024-11-25T19:37:56.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75892024-11-25T19:37:56.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75902024-11-25T19:37:56.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75912024-11-25T19:37:56.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75922024-11-25T19:37:56.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75932024-11-25T19:37:56.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75942024-11-25T19:37:56.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75952024-11-25T19:37:56.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75962024-11-25T19:37:56.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
75972024-11-25T19:37:56.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75982024-11-25T19:37:56.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75992024-11-25T19:37:56.876ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
76002024-11-25T19:37:56.876ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.611242ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
76012024-11-25T19:37:56.884ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.794372ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76022024-11-25T19:37:57.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 53aabc29-0bac-463b-a0fb-6ed020e56b9b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76032024-11-25T19:37:57.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 53aabc29-0bac-463b-a0fb-6ed020e56b9b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76042024-11-25T19:37:57.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 53aabc29-0bac-463b-a0fb-6ed020e56b9b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76052024-11-25T19:37:58.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8ed4ff88-12b9-439d-90c7-ff1973080ef9 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76062024-11-25T19:37:58.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8ed4ff88-12b9-439d-90c7-ff1973080ef9 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76072024-11-25T19:37:58.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8ed4ff88-12b9-439d-90c7-ff1973080ef9 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76082024-11-25T19:37:59.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c027ea60-bccb-4daf-bd53-8c32cbe68956 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76092024-11-25T19:37:59.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c027ea60-bccb-4daf-bd53-8c32cbe68956 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76102024-11-25T19:37:59.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c027ea60-bccb-4daf-bd53-8c32cbe68956 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76112024-11-25T19:38:00.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1ddc9278-f507-44bc-be8e-c70203e32b62 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76122024-11-25T19:38:00.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1ddc9278-f507-44bc-be8e-c70203e32b62 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76132024-11-25T19:38:00.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1ddc9278-f507-44bc-be8e-c70203e32b62 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76142024-11-25T19:38:01.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 41bcfc84-699c-4aae-878c-4aaae91d6ee4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76152024-11-25T19:38:01.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 41bcfc84-699c-4aae-878c-4aaae91d6ee4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76162024-11-25T19:38:01.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 41bcfc84-699c-4aae-878c-4aaae91d6ee4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76172024-11-25T19:38:02.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 490 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = fccb835d-c1c1-4360-9d43-316ac630d4b7 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
76182024-11-25T19:38:02.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bd54163f-08b1-4d46-aee0-9520ff674059 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76192024-11-25T19:38:02.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bd54163f-08b1-4d46-aee0-9520ff674059 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76202024-11-25T19:38:02.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bd54163f-08b1-4d46-aee0-9520ff674059 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76212024-11-25T19:38:03.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ed2a736d-8f0b-4e8c-af24-15b2167d9072 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76222024-11-25T19:38:03.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ed2a736d-8f0b-4e8c-af24-15b2167d9072 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76232024-11-25T19:38:03.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2602 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ed2a736d-8f0b-4e8c-af24-15b2167d9072 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76242024-11-25T19:38:04.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a4074fcd-06e4-41c8-a020-51dfad38c9e4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76252024-11-25T19:38:04.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a4074fcd-06e4-41c8-a020-51dfad38c9e4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76262024-11-25T19:38:04.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a4074fcd-06e4-41c8-a020-51dfad38c9e4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76272024-11-25T19:38:05.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c5fceada-527e-4f13-bb3b-e0efa5c5c054 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76282024-11-25T19:38:05.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c5fceada-527e-4f13-bb3b-e0efa5c5c054 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76292024-11-25T19:38:05.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c5fceada-527e-4f13-bb3b-e0efa5c5c054 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76302024-11-25T19:38:06.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
76312024-11-25T19:38:06.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76322024-11-25T19:38:06.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
76332024-11-25T19:38:06.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76342024-11-25T19:38:06.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76352024-11-25T19:38:06.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76362024-11-25T19:38:06.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76372024-11-25T19:38:06.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76382024-11-25T19:38:06.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76392024-11-25T19:38:06.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.763514ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76402024-11-25T19:38:06.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76412024-11-25T19:38:06.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76422024-11-25T19:38:06.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76432024-11-25T19:38:06.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d90aabab-dbe9-47bb-b5ad-1447979f0187 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76442024-11-25T19:38:06.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d90aabab-dbe9-47bb-b5ad-1447979f0187 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76452024-11-25T19:38:06.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76462024-11-25T19:38:06.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76472024-11-25T19:38:06.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d90aabab-dbe9-47bb-b5ad-1447979f0187 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76482024-11-25T19:38:06.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76492024-11-25T19:38:06.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
76502024-11-25T19:38:06.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76512024-11-25T19:38:06.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76522024-11-25T19:38:06.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
76532024-11-25T19:38:06.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.628344ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
76542024-11-25T19:38:07.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c38b61f8-3644-4f39-992c-7ce26e0cbd06 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76552024-11-25T19:38:07.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c38b61f8-3644-4f39-992c-7ce26e0cbd06 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76562024-11-25T19:38:07.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c38b61f8-3644-4f39-992c-7ce26e0cbd06 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76572024-11-25T19:38:08.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5cb6f8cf-f090-44d5-a316-4a9f7b30e52e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76582024-11-25T19:38:08.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5cb6f8cf-f090-44d5-a316-4a9f7b30e52e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76592024-11-25T19:38:08.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5cb6f8cf-f090-44d5-a316-4a9f7b30e52e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76602024-11-25T19:38:09.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 631b2b14-a97d-4454-9ef0-511b89493e8c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76612024-11-25T19:38:09.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 631b2b14-a97d-4454-9ef0-511b89493e8c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76622024-11-25T19:38:09.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 631b2b14-a97d-4454-9ef0-511b89493e8c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76632024-11-25T19:38:10.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 22a89926-0187-4d1d-bef3-6048f05699a7 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76642024-11-25T19:38:10.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 22a89926-0187-4d1d-bef3-6048f05699a7 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76652024-11-25T19:38:10.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 22a89926-0187-4d1d-bef3-6048f05699a7 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76662024-11-25T19:38:11.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b12eb608-59c4-4623-9e8c-6a68c2ea9b1b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76672024-11-25T19:38:11.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b12eb608-59c4-4623-9e8c-6a68c2ea9b1b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76682024-11-25T19:38:11.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b12eb608-59c4-4623-9e8c-6a68c2ea9b1b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76692024-11-25T19:38:12.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 482 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 1539e708-aedf-441e-b286-e4ca023fa7a2 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
76702024-11-25T19:38:12.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7a4c8de1-ddc6-49b9-94a1-d960167e9e55 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76712024-11-25T19:38:12.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7a4c8de1-ddc6-49b9-94a1-d960167e9e55 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76722024-11-25T19:38:12.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7a4c8de1-ddc6-49b9-94a1-d960167e9e55 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76732024-11-25T19:38:14.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4461fc1f-2dc6-4558-aad8-f80de79a7280 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76742024-11-25T19:38:14.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4461fc1f-2dc6-4558-aad8-f80de79a7280 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76752024-11-25T19:38:14.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4461fc1f-2dc6-4558-aad8-f80de79a7280 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76762024-11-25T19:38:15.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fd22f34a-3c17-4006-904e-6ea2f5d86144 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76772024-11-25T19:38:15.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fd22f34a-3c17-4006-904e-6ea2f5d86144 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76782024-11-25T19:38:15.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1660 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fd22f34a-3c17-4006-904e-6ea2f5d86144 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76792024-11-25T19:38:16.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fcb88e94-173f-4aa3-b639-820c72f35206 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76802024-11-25T19:38:16.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fcb88e94-173f-4aa3-b639-820c72f35206 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76812024-11-25T19:38:16.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fcb88e94-173f-4aa3-b639-820c72f35206 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
76822024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
76832024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
76842024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
76852024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
76862024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
76872024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76882024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76892024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
76902024-11-25T19:38:16.848ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
76912024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
76922024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.74\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
76932024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
76942024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76952024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
76962024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
76972024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
76982024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
76992024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
77002024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
77012024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
77022024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77032024-11-25T19:38:16.848ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
77042024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
77052024-11-25T19:38:16.849ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
77062024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
77072024-11-25T19:38:16.849ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
77082024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77092024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
77102024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77112024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
77122024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
77132024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
77142024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77152024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
77162024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
77172024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
77182024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77192024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77202024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
77212024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77222024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77232024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
77242024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
77252024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77262024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
77272024-11-25T19:38:16.849ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:28:16.849047568 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
77282024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
77292024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
77302024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77312024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
77322024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77332024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
77342024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
77352024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
77362024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
77372024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
77382024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
77392024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77402024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
77412024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
77422024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
77432024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77442024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
77452024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77462024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77472024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77482024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77492024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77502024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
77512024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77522024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
77532024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77542024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77552024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
77562024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
77572024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77582024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
77592024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
77602024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77612024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77622024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77632024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
77642024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77652024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77662024-11-25T19:38:16.849ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1522, tv_nsec: 395100978 } })
77672024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77682024-11-25T19:38:16.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77692024-11-25T19:38:16.849ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1522, tv_nsec: 395132598 } })
77702024-11-25T19:38:16.850ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
77712024-11-25T19:38:16.850ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.289606ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
77722024-11-25T19:38:16.850ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
77732024-11-25T19:38:16.850ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.425717ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
77742024-11-25T19:38:16.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77752024-11-25T19:38:16.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.453728ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
77762024-11-25T19:38:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77772024-11-25T19:38:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.634821ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
77782024-11-25T19:38:16.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77792024-11-25T19:38:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77802024-11-25T19:38:16.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77812024-11-25T19:38:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77822024-11-25T19:38:16.855ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1522, tv_nsec: 400663827 } })
77832024-11-25T19:38:16.855ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
77842024-11-25T19:38:16.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77852024-11-25T19:38:16.857ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.352304ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
77862024-11-25T19:38:16.858ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:28:16.849047568 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
77872024-11-25T19:38:16.858ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.494306ms iteration = 8 status = {"expiration":"2024-11-25T19:28:16.849047568Z","pruned":[]}
77882024-11-25T19:38:16.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
77892024-11-25T19:38:16.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77902024-11-25T19:38:16.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77912024-11-25T19:38:16.867ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77922024-11-25T19:38:16.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77932024-11-25T19:38:16.868ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1522, tv_nsec: 413906657 } })
77942024-11-25T19:38:16.868ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
77952024-11-25T19:38:16.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77962024-11-25T19:38:16.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77972024-11-25T19:38:16.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77982024-11-25T19:38:16.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77992024-11-25T19:38:16.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78002024-11-25T19:38:16.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78012024-11-25T19:38:16.878ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78022024-11-25T19:38:16.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78032024-11-25T19:38:16.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78042024-11-25T19:38:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78052024-11-25T19:38:16.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78062024-11-25T19:38:16.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78072024-11-25T19:38:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78082024-11-25T19:38:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
78092024-11-25T19:38:16.902ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78102024-11-25T19:38:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78112024-11-25T19:38:16.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78122024-11-25T19:38:16.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78132024-11-25T19:38:16.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1522, tv_nsec: 450943033 } })
78142024-11-25T19:38:16.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
78152024-11-25T19:38:16.907ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78162024-11-25T19:38:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78172024-11-25T19:38:16.907ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78182024-11-25T19:38:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78192024-11-25T19:38:16.908ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78202024-11-25T19:38:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
78212024-11-25T19:38:16.911ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
78222024-11-25T19:38:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
78232024-11-25T19:38:16.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.524187ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
78242024-11-25T19:38:16.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78252024-11-25T19:38:16.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78262024-11-25T19:38:16.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 64.626328ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
78272024-11-25T19:38:16.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78282024-11-25T19:38:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78292024-11-25T19:38:16.914ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78302024-11-25T19:38:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78312024-11-25T19:38:16.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78322024-11-25T19:38:16.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78332024-11-25T19:38:16.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78342024-11-25T19:38:16.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78352024-11-25T19:38:16.917ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78362024-11-25T19:38:16.917ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78372024-11-25T19:38:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78382024-11-25T19:38:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
78392024-11-25T19:38:16.917ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78402024-11-25T19:38:16.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78412024-11-25T19:38:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
78422024-11-25T19:38:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
78432024-11-25T19:38:16.919ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78442024-11-25T19:38:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78452024-11-25T19:38:16.921ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
78462024-11-25T19:38:16.921ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
78472024-11-25T19:38:16.921ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
78482024-11-25T19:38:16.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78492024-11-25T19:38:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78502024-11-25T19:38:16.922ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78512024-11-25T19:38:16.922ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78522024-11-25T19:38:16.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78532024-11-25T19:38:16.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78542024-11-25T19:38:16.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78552024-11-25T19:38:16.923ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78562024-11-25T19:38:16.924ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78572024-11-25T19:38:16.925ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 76.735756ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78582024-11-25T19:38:16.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78592024-11-25T19:38:16.926ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
78602024-11-25T19:38:16.926ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
78612024-11-25T19:38:16.926ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 77.696244ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
78622024-11-25T19:38:16.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
78632024-11-25T19:38:16.927ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78642024-11-25T19:38:16.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78652024-11-25T19:38:16.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
78662024-11-25T19:38:16.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78672024-11-25T19:38:16.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
78682024-11-25T19:38:16.928ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78692024-11-25T19:38:16.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78702024-11-25T19:38:16.928ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78712024-11-25T19:38:16.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78722024-11-25T19:38:16.929ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78732024-11-25T19:38:16.929ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
78742024-11-25T19:38:16.929ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78752024-11-25T19:38:16.929ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78762024-11-25T19:38:16.929ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 80.290825ms iteration = 15 status = 0
78772024-11-25T19:38:16.929ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78782024-11-25T19:38:16.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78792024-11-25T19:38:16.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78802024-11-25T19:38:16.930ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78812024-11-25T19:38:16.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78822024-11-25T19:38:16.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78832024-11-25T19:38:16.934ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
78842024-11-25T19:38:16.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
78852024-11-25T19:38:16.937ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
78862024-11-25T19:38:16.937ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.362754ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
78872024-11-25T19:38:16.945ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 96.141926ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
78882024-11-25T19:38:16.958ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
78892024-11-25T19:38:16.958ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
78902024-11-25T19:38:16.958ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 109.188552ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
78912024-11-25T19:38:16.959ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78922024-11-25T19:38:16.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78932024-11-25T19:38:16.961ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
78942024-11-25T19:38:16.961ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 112.041868ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
78952024-11-25T19:38:16.968ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78962024-11-25T19:38:16.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78972024-11-25T19:38:16.971ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78982024-11-25T19:38:16.973ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78992024-11-25T19:38:16.974ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79002024-11-25T19:38:16.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79012024-11-25T19:38:16.976ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
79022024-11-25T19:38:16.976ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
79032024-11-25T19:38:16.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79042024-11-25T19:38:16.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79052024-11-25T19:38:16.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79062024-11-25T19:38:16.979ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 130.795846ms iteration = 17 status = {"physical_disks_added":0}
79072024-11-25T19:38:16.981ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 132.894037ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79082024-11-25T19:38:16.983ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
79092024-11-25T19:38:16.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79102024-11-25T19:38:16.983ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79112024-11-25T19:38:16.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79122024-11-25T19:38:16.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79132024-11-25T19:38:16.985ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
79142024-11-25T19:38:16.985ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
79152024-11-25T19:38:16.985ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
79162024-11-25T19:38:16.985ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
79172024-11-25T19:38:16.985ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79182024-11-25T19:38:16.985ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
79192024-11-25T19:38:16.985ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
79202024-11-25T19:38:16.985ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 136.568189ms iteration = 8 status = {"generation":1}
79212024-11-25T19:38:16.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79222024-11-25T19:38:16.986ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79232024-11-25T19:38:16.986ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79242024-11-25T19:38:16.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79252024-11-25T19:38:16.987ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79262024-11-25T19:38:16.988ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79272024-11-25T19:38:16.988ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
79282024-11-25T19:38:16.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79292024-11-25T19:38:16.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79302024-11-25T19:38:16.989ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79312024-11-25T19:38:16.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79322024-11-25T19:38:16.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79332024-11-25T19:38:16.990ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
79342024-11-25T19:38:16.991ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
79352024-11-25T19:38:16.991ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
79362024-11-25T19:38:16.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79372024-11-25T19:38:16.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79382024-11-25T19:38:16.993ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79392024-11-25T19:38:16.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79402024-11-25T19:38:16.996ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79412024-11-25T19:38:16.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79422024-11-25T19:38:17.014ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
79432024-11-25T19:38:17.014ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79442024-11-25T19:38:17.014ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "599790ab-eb75-4d58-9de6-07f7e0374ecb", "content-length": "26", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
79452024-11-25T19:38:17.014ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79462024-11-25T19:38:17.016ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79472024-11-25T19:38:17.017ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
79482024-11-25T19:38:17.017ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79492024-11-25T19:38:17.018ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fb61d00-e6ef-4833-84ee-565ceaec3367", "content-length": "26", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
79502024-11-25T19:38:17.018ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79512024-11-25T19:38:17.018ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79522024-11-25T19:38:17.018ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
79532024-11-25T19:38:17.018ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 169.022636ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
79542024-11-25T19:38:17.019ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
79552024-11-25T19:38:17.019ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 170.540696ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
79562024-11-25T19:38:17.019ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79572024-11-25T19:38:17.038ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
79582024-11-25T19:38:17.038ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 189.585209ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
79592024-11-25T19:38:17.060ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
79602024-11-25T19:38:17.060ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79612024-11-25T19:38:17.060ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "69232fdd-63b1-4e25-84f7-7b5303b37ce6", "content-length": "26", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
79622024-11-25T19:38:17.060ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79632024-11-25T19:38:17.060ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79642024-11-25T19:38:17.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79652024-11-25T19:38:17.062ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
79662024-11-25T19:38:17.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 35acfe41-4100-4a9f-b240-8b6ae39ae25e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
79672024-11-25T19:38:17.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 35acfe41-4100-4a9f-b240-8b6ae39ae25e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
79682024-11-25T19:38:17.179ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
79692024-11-25T19:38:17.179ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "81127612-e5fb-4057-8d2d-9422edefbfe5", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79702024-11-25T19:38:17.179ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79712024-11-25T19:38:17.181ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7fa8b77c-a78e-4658-b9e7-03d9b8db29e3", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79722024-11-25T19:38:17.181ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79732024-11-25T19:38:17.182ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79742024-11-25T19:38:17.182ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 333.774709ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
79752024-11-25T19:38:17.185ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
79762024-11-25T19:38:17.190ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 341.598362ms iteration = 15 status = {}
79772024-11-25T19:38:17.309ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
79782024-11-25T19:38:17.309ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f962ca45-d9bd-459b-9e3f-f276c8757437", "date": "Mon, 25 Nov 2024 19:38:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
79792024-11-25T19:38:17.309ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
79802024-11-25T19:38:17.311ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "be2f50ea-d4a3-42ed-99f7-34d7787f75ed", "date": "Mon, 25 Nov 2024 19:38:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
79812024-11-25T19:38:17.311ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
79822024-11-25T19:38:17.313ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "260f4a36-77ce-40df-894b-c43bc0b8be1b", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
79832024-11-25T19:38:17.313ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
79842024-11-25T19:38:17.315ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
79852024-11-25T19:38:17.315ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 466.303909ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
79862024-11-25T19:38:17.381ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
79872024-11-25T19:38:17.381ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79882024-11-25T19:38:17.382ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "52df9371-f110-4904-bdf8-23a9c4c8c2ff", "content-length": "372", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
79892024-11-25T19:38:17.382ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79902024-11-25T19:38:17.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79912024-11-25T19:38:17.383ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
79922024-11-25T19:38:17.383ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
79932024-11-25T19:38:17.383ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
79942024-11-25T19:38:17.383ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 534.929645ms iteration = 8 status = {"generation":2}
79952024-11-25T19:38:17.384ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79962024-11-25T19:38:17.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 318522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 35acfe41-4100-4a9f-b240-8b6ae39ae25e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
79972024-11-25T19:38:17.386ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79982024-11-25T19:38:17.386ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79992024-11-25T19:38:17.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80002024-11-25T19:38:17.387ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80012024-11-25T19:38:17.388ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
80022024-11-25T19:38:17.388ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb9a4631-7211-48e8-af2d-273f875da415", "content-length": "1", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
80032024-11-25T19:38:17.389ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80042024-11-25T19:38:17.389ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80052024-11-25T19:38:17.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80062024-11-25T19:38:17.390ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80072024-11-25T19:38:17.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80082024-11-25T19:38:17.391ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 542.8603ms iteration = 15 status = null
80092024-11-25T19:38:17.427ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
80102024-11-25T19:38:17.427ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
80112024-11-25T19:38:17.427ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "909d9e33-cdec-4877-9304-52869e3df63a", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
80122024-11-25T19:38:17.427ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80132024-11-25T19:38:17.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80142024-11-25T19:38:17.429ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80152024-11-25T19:38:17.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80162024-11-25T19:38:17.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80172024-11-25T19:38:17.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80182024-11-25T19:38:17.436ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
80192024-11-25T19:38:17.436ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80202024-11-25T19:38:17.436ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "90ff624a-2d0c-4023-ac9c-3384639e15aa", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
80212024-11-25T19:38:17.438ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 589.801822ms iteration = 15 status = {}
80222024-11-25T19:38:17.454ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
80232024-11-25T19:38:17.455ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0dfdcf6-b31e-4bbd-a1c2-e055ca9df275", "content-length": "691", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
80242024-11-25T19:38:17.455ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
80252024-11-25T19:38:17.455ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
80262024-11-25T19:38:17.455ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
80272024-11-25T19:38:17.456ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 607.437318ms iteration = 15 status = {}
80282024-11-25T19:38:17.481ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80292024-11-25T19:38:17.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80302024-11-25T19:38:17.482ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
80312024-11-25T19:38:17.482ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80322024-11-25T19:38:17.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80332024-11-25T19:38:17.492ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
80342024-11-25T19:38:17.492ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "087b2b1a-ed0e-433c-90d8-0247590b58f4", "content-length": "134", "date": "Mon, 25 Nov 2024 19:38:17 GMT"} })
80352024-11-25T19:38:17.492ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
80362024-11-25T19:38:17.492ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
80372024-11-25T19:38:17.493ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
80382024-11-25T19:38:17.493ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
80392024-11-25T19:38:17.493ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80402024-11-25T19:38:17.493ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80412024-11-25T19:38:17.493ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80422024-11-25T19:38:17.493ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80432024-11-25T19:38:17.493ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80442024-11-25T19:38:17.493ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80452024-11-25T19:38:17.493ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
80462024-11-25T19:38:17.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80472024-11-25T19:38:17.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80482024-11-25T19:38:17.495ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
80492024-11-25T19:38:17.495ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba4f4b86-6563-41d1-9245-41c36c39feec", "content-length": "2", "date": "Mon, 25 Nov 2024 19:38:17 GMT"} })
80502024-11-25T19:38:17.495ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
80512024-11-25T19:38:17.496ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "83cff4ca-ce04-459a-9bb6-d12e7bfe15d6", "content-length": "51", "date": "Mon, 25 Nov 2024 19:38:17 GMT"} })
80522024-11-25T19:38:17.496ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
80532024-11-25T19:38:17.496ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
80542024-11-25T19:38:17.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 3659ac43-b2e1-42c3-a920-360514e4af8b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
80552024-11-25T19:38:17.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 3659ac43-b2e1-42c3-a920-360514e4af8b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
80562024-11-25T19:38:17.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 3659ac43-b2e1-42c3-a920-360514e4af8b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
80572024-11-25T19:38:17.590ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "95a55094-48a1-44b0-a5df-e74d04afa07f", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
80582024-11-25T19:38:17.590ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
80592024-11-25T19:38:17.590ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
80602024-11-25T19:38:17.591ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c59877e-0b2a-4eeb-80e9-90bbc0aef50c", "content-length": "682", "date": "Mon, 25 Nov 2024 19:38:17 GMT"} })
80612024-11-25T19:38:17.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80622024-11-25T19:38:17.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80632024-11-25T19:38:17.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80642024-11-25T19:38:17.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80652024-11-25T19:38:17.599ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80662024-11-25T19:38:17.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80672024-11-25T19:38:17.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80682024-11-25T19:38:17.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80692024-11-25T19:38:17.608ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 759.064543ms iteration = 15 status = {}
80702024-11-25T19:38:18.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c1ecfac9-c787-4fff-b041-b52b590929b0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80712024-11-25T19:38:18.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c1ecfac9-c787-4fff-b041-b52b590929b0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80722024-11-25T19:38:18.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1698 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c1ecfac9-c787-4fff-b041-b52b590929b0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80732024-11-25T19:38:19.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d2f90ee7-175e-4d5a-b2e0-f18c42ca8bf6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80742024-11-25T19:38:19.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d2f90ee7-175e-4d5a-b2e0-f18c42ca8bf6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80752024-11-25T19:38:19.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d2f90ee7-175e-4d5a-b2e0-f18c42ca8bf6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80762024-11-25T19:38:20.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a8266918-a915-43ea-a6d6-8b22e0f4b1bc roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80772024-11-25T19:38:20.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a8266918-a915-43ea-a6d6-8b22e0f4b1bc resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80782024-11-25T19:38:20.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a8266918-a915-43ea-a6d6-8b22e0f4b1bc response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80792024-11-25T19:38:21.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 470f773f-8dfd-4339-8f12-aad58ae6eb27 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80802024-11-25T19:38:21.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 470f773f-8dfd-4339-8f12-aad58ae6eb27 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80812024-11-25T19:38:21.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 470f773f-8dfd-4339-8f12-aad58ae6eb27 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80822024-11-25T19:38:22.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 497 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = f62581d7-83b3-4bf2-844f-4f384cfc0f74 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
80832024-11-25T19:38:22.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 54e9ac60-6468-4461-9323-616ee204a82e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80842024-11-25T19:38:22.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 54e9ac60-6468-4461-9323-616ee204a82e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80852024-11-25T19:38:22.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 54e9ac60-6468-4461-9323-616ee204a82e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80862024-11-25T19:38:23.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1d28ec18-733a-44dc-9aba-b16835572d58 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80872024-11-25T19:38:23.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1d28ec18-733a-44dc-9aba-b16835572d58 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80882024-11-25T19:38:23.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2642 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1d28ec18-733a-44dc-9aba-b16835572d58 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80892024-11-25T19:38:24.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a0c88885-b402-4659-b8be-134727fc5246 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80902024-11-25T19:38:24.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a0c88885-b402-4659-b8be-134727fc5246 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80912024-11-25T19:38:24.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a0c88885-b402-4659-b8be-134727fc5246 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80922024-11-25T19:38:25.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ae5d49ed-41d0-47b1-b4be-b4f403612821 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80932024-11-25T19:38:25.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ae5d49ed-41d0-47b1-b4be-b4f403612821 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80942024-11-25T19:38:25.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ae5d49ed-41d0-47b1-b4be-b4f403612821 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80952024-11-25T19:38:26.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = efa8d31c-8119-4e65-9f10-fff03251f88f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80962024-11-25T19:38:26.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = efa8d31c-8119-4e65-9f10-fff03251f88f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80972024-11-25T19:38:26.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = efa8d31c-8119-4e65-9f10-fff03251f88f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
80982024-11-25T19:38:26.848ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
80992024-11-25T19:38:26.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
81002024-11-25T19:38:26.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81012024-11-25T19:38:26.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81022024-11-25T19:38:26.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81032024-11-25T19:38:26.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81042024-11-25T19:38:26.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81052024-11-25T19:38:26.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81062024-11-25T19:38:26.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81072024-11-25T19:38:26.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81082024-11-25T19:38:26.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81092024-11-25T19:38:26.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81102024-11-25T19:38:26.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81112024-11-25T19:38:26.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
81122024-11-25T19:38:26.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81132024-11-25T19:38:26.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81142024-11-25T19:38:26.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
81152024-11-25T19:38:26.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.058962ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
81162024-11-25T19:38:26.879ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81172024-11-25T19:38:26.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81182024-11-25T19:38:26.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.17218ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81192024-11-25T19:38:27.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 694672a3-368b-43c7-9f35-749287214cce roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81202024-11-25T19:38:27.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 694672a3-368b-43c7-9f35-749287214cce resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81212024-11-25T19:38:27.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 694672a3-368b-43c7-9f35-749287214cce response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81222024-11-25T19:38:28.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7a7ddd91-27b0-421b-9605-1121e573ceec roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81232024-11-25T19:38:28.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7a7ddd91-27b0-421b-9605-1121e573ceec resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81242024-11-25T19:38:28.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7a7ddd91-27b0-421b-9605-1121e573ceec response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81252024-11-25T19:38:29.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 76e3fc8a-d5ca-4d3c-8d48-489d24a23925 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81262024-11-25T19:38:29.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 76e3fc8a-d5ca-4d3c-8d48-489d24a23925 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81272024-11-25T19:38:29.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 76e3fc8a-d5ca-4d3c-8d48-489d24a23925 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81282024-11-25T19:38:30.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5e7e66e7-9dd8-45d6-baec-0987293b233d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81292024-11-25T19:38:30.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5e7e66e7-9dd8-45d6-baec-0987293b233d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81302024-11-25T19:38:30.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5e7e66e7-9dd8-45d6-baec-0987293b233d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81312024-11-25T19:38:31.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 89fafe18-ddce-4edb-92e2-865828333348 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81322024-11-25T19:38:31.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 89fafe18-ddce-4edb-92e2-865828333348 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81332024-11-25T19:38:31.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 89fafe18-ddce-4edb-92e2-865828333348 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81342024-11-25T19:38:32.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 493 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = eca427ec-d11b-40a0-8bb3-0929880b1226 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
81352024-11-25T19:38:32.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e49c0a70-3217-4518-ad9d-36ed17100e1b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81362024-11-25T19:38:32.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e49c0a70-3217-4518-ad9d-36ed17100e1b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81372024-11-25T19:38:32.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e49c0a70-3217-4518-ad9d-36ed17100e1b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81382024-11-25T19:38:33.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3d27436b-33b1-4371-9e16-8092bf87526b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81392024-11-25T19:38:33.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3d27436b-33b1-4371-9e16-8092bf87526b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81402024-11-25T19:38:33.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3d27436b-33b1-4371-9e16-8092bf87526b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81412024-11-25T19:38:34.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e979210e-cf4d-465f-9fd0-d82a458ba68c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81422024-11-25T19:38:34.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e979210e-cf4d-465f-9fd0-d82a458ba68c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81432024-11-25T19:38:34.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e979210e-cf4d-465f-9fd0-d82a458ba68c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81442024-11-25T19:38:35.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3019e538-0b0d-4365-ac25-8e6ab945f306 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81452024-11-25T19:38:35.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3019e538-0b0d-4365-ac25-8e6ab945f306 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81462024-11-25T19:38:35.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3019e538-0b0d-4365-ac25-8e6ab945f306 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81472024-11-25T19:38:36.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f019b84b-5978-4673-89c6-a0bf7c6864ac roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81482024-11-25T19:38:36.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f019b84b-5978-4673-89c6-a0bf7c6864ac resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81492024-11-25T19:38:36.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f019b84b-5978-4673-89c6-a0bf7c6864ac response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81502024-11-25T19:38:36.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
81512024-11-25T19:38:36.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
81522024-11-25T19:38:36.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81532024-11-25T19:38:36.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81542024-11-25T19:38:36.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81552024-11-25T19:38:36.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81562024-11-25T19:38:36.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81572024-11-25T19:38:36.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81582024-11-25T19:38:36.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81592024-11-25T19:38:36.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81602024-11-25T19:38:36.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81612024-11-25T19:38:36.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81622024-11-25T19:38:36.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81632024-11-25T19:38:36.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81642024-11-25T19:38:36.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81652024-11-25T19:38:36.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
81662024-11-25T19:38:36.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81672024-11-25T19:38:36.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81682024-11-25T19:38:36.868ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
81692024-11-25T19:38:36.868ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.208146ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
81702024-11-25T19:38:36.879ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.491199ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81712024-11-25T19:38:37.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 3ec8f69e-78d1-4a01-90c9-9c5e553f6790 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
81722024-11-25T19:38:37.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 3ec8f69e-78d1-4a01-90c9-9c5e553f6790 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
81732024-11-25T19:38:37.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 3ec8f69e-78d1-4a01-90c9-9c5e553f6790 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
81742024-11-25T19:38:37.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 739429b4-8bfd-482e-a862-b784b0b61f8f roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
81752024-11-25T19:38:37.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 739429b4-8bfd-482e-a862-b784b0b61f8f resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
81762024-11-25T19:38:37.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 739429b4-8bfd-482e-a862-b784b0b61f8f response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
81772024-11-25T19:38:37.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1b9c9ce4-74c9-43f4-8573-f9273ed0c633 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81782024-11-25T19:38:37.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1b9c9ce4-74c9-43f4-8573-f9273ed0c633 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81792024-11-25T19:38:37.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1b9c9ce4-74c9-43f4-8573-f9273ed0c633 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81802024-11-25T19:38:38.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6bc166bb-7386-4214-a2ee-5aafc210ddc6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81812024-11-25T19:38:38.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6bc166bb-7386-4214-a2ee-5aafc210ddc6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81822024-11-25T19:38:38.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6bc166bb-7386-4214-a2ee-5aafc210ddc6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81832024-11-25T19:38:39.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b346e203-f777-4676-93a4-0b4f1035f361 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81842024-11-25T19:38:39.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b346e203-f777-4676-93a4-0b4f1035f361 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81852024-11-25T19:38:39.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b346e203-f777-4676-93a4-0b4f1035f361 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81862024-11-25T19:38:40.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f6b9ea7d-6793-48e5-8972-09763e8f10a5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81872024-11-25T19:38:40.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f6b9ea7d-6793-48e5-8972-09763e8f10a5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81882024-11-25T19:38:40.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f6b9ea7d-6793-48e5-8972-09763e8f10a5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81892024-11-25T19:38:41.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bfd2d33d-7687-4446-8cf8-6f6111539636 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81902024-11-25T19:38:41.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bfd2d33d-7687-4446-8cf8-6f6111539636 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81912024-11-25T19:38:41.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bfd2d33d-7687-4446-8cf8-6f6111539636 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81922024-11-25T19:38:42.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 492 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 8084bf0d-506c-4fcc-89e6-7a1dd9931a63 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
81932024-11-25T19:38:42.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 707d4fc4-4c45-458a-a624-43b39821f94c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81942024-11-25T19:38:42.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 707d4fc4-4c45-458a-a624-43b39821f94c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81952024-11-25T19:38:42.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 707d4fc4-4c45-458a-a624-43b39821f94c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81962024-11-25T19:38:43.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f127d33b-4dee-402f-bd16-d61e2c6f54e2 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81972024-11-25T19:38:43.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f127d33b-4dee-402f-bd16-d61e2c6f54e2 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81982024-11-25T19:38:43.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f127d33b-4dee-402f-bd16-d61e2c6f54e2 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
81992024-11-25T19:38:44.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 06fadd13-9454-4a24-b354-c18388e1d4bc roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
82002024-11-25T19:38:44.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 06fadd13-9454-4a24-b354-c18388e1d4bc resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
82012024-11-25T19:38:44.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 06fadd13-9454-4a24-b354-c18388e1d4bc response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
82022024-11-25T19:38:45.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1a3b3b96-ef15-42dc-829e-be2315a168b7 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
82032024-11-25T19:38:45.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1a3b3b96-ef15-42dc-829e-be2315a168b7 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
82042024-11-25T19:38:45.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1a3b3b96-ef15-42dc-829e-be2315a168b7 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
82052024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
82062024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
82072024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82082024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
82092024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82102024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
82112024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
82122024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
82132024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82142024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
82152024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82162024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
82172024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
82182024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82192024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82202024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
82212024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
82222024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82232024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82242024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
82252024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
82262024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82272024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82282024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
82292024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
82302024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
82312024-11-25T19:38:46.850ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
82322024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82332024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
82342024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
82352024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82362024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
82372024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82382024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82392024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
82402024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
82412024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82422024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
82432024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82442024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82452024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82462024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82472024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82482024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82492024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82502024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82512024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82522024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82532024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
82542024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82552024-11-25T19:38:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
82562024-11-25T19:38:46.853ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1552, tv_nsec: 398090956 } })
82572024-11-25T19:38:46.853ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
82582024-11-25T19:38:46.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82592024-11-25T19:38:46.854ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.772194ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
82602024-11-25T19:38:46.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1552, tv_nsec: 399533035 } })
82612024-11-25T19:38:46.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
82622024-11-25T19:38:46.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82632024-11-25T19:38:46.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82642024-11-25T19:38:46.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82652024-11-25T19:38:46.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
82662024-11-25T19:38:46.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82672024-11-25T19:38:46.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82682024-11-25T19:38:46.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82692024-11-25T19:38:46.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82702024-11-25T19:38:46.857ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82712024-11-25T19:38:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82722024-11-25T19:38:46.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82732024-11-25T19:38:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82742024-11-25T19:38:46.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82752024-11-25T19:38:46.858ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82762024-11-25T19:38:46.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82772024-11-25T19:38:46.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82782024-11-25T19:38:46.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82792024-11-25T19:38:46.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82802024-11-25T19:38:46.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82812024-11-25T19:38:46.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82822024-11-25T19:38:46.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
82832024-11-25T19:38:46.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82842024-11-25T19:38:46.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82852024-11-25T19:38:46.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
82862024-11-25T19:38:46.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82872024-11-25T19:38:46.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82882024-11-25T19:38:46.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82892024-11-25T19:38:46.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82902024-11-25T19:38:46.866ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1552, tv_nsec: 411812806 } })
82912024-11-25T19:38:46.867ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
82922024-11-25T19:38:46.867ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82932024-11-25T19:38:46.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82942024-11-25T19:38:46.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82952024-11-25T19:38:46.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82962024-11-25T19:38:46.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82972024-11-25T19:38:46.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82982024-11-25T19:38:46.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82992024-11-25T19:38:46.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83002024-11-25T19:38:46.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83012024-11-25T19:38:46.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83022024-11-25T19:38:46.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83032024-11-25T19:38:46.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83042024-11-25T19:38:46.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83052024-11-25T19:38:46.873ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
83062024-11-25T19:38:46.873ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 23.260706ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
83072024-11-25T19:38:46.888ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83082024-11-25T19:38:46.888ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
83092024-11-25T19:38:46.888ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83102024-11-25T19:38:46.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83112024-11-25T19:38:46.891ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83122024-11-25T19:38:46.891ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
83132024-11-25T19:38:46.891ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83142024-11-25T19:38:46.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83152024-11-25T19:38:46.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 43.008353ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
83162024-11-25T19:38:46.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83172024-11-25T19:38:46.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83182024-11-25T19:38:46.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83192024-11-25T19:38:46.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83202024-11-25T19:38:46.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.42952ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
83212024-11-25T19:38:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83222024-11-25T19:38:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83232024-11-25T19:38:46.900ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
83242024-11-25T19:38:46.900ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83252024-11-25T19:38:46.901ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1403601c-1e1c-4e9b-bc84-3d78a603c9d0", "content-length": "26", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
83262024-11-25T19:38:46.901ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83272024-11-25T19:38:46.902ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83282024-11-25T19:38:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83292024-11-25T19:38:46.902ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83302024-11-25T19:38:46.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83312024-11-25T19:38:46.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83322024-11-25T19:38:46.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.788474ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
83332024-11-25T19:38:46.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.705082ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83342024-11-25T19:38:46.911ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
83352024-11-25T19:38:46.911ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83362024-11-25T19:38:46.911ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b39d711e-e4b0-4a8e-970c-5ff81846d3f1", "content-length": "26", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
83372024-11-25T19:38:46.912ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83382024-11-25T19:38:46.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83392024-11-25T19:38:46.913ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83402024-11-25T19:38:46.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
83412024-11-25T19:38:46.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83422024-11-25T19:38:46.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83432024-11-25T19:38:46.927ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
83442024-11-25T19:38:46.927ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83452024-11-25T19:38:46.927ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
83462024-11-25T19:38:46.927ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.722765ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
83472024-11-25T19:38:46.928ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d157752-d692-4558-b814-e777e0d13403", "content-length": "26", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
83482024-11-25T19:38:46.928ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83492024-11-25T19:38:46.929ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
83502024-11-25T19:38:46.935ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83512024-11-25T19:38:46.935ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
83522024-11-25T19:38:46.935ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 85.741422ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
83532024-11-25T19:38:46.938ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 88.504156ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
83542024-11-25T19:38:46.942ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83552024-11-25T19:38:46.945ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
83562024-11-25T19:38:46.945ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83572024-11-25T19:38:46.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83582024-11-25T19:38:46.947ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 97.291209ms iteration = 16 status = 0
83592024-11-25T19:38:46.948ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 98.591954ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
83602024-11-25T19:38:46.973ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83612024-11-25T19:38:46.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83622024-11-25T19:38:46.981ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 131.465999ms iteration = 18 status = {"physical_disks_added":0}
83632024-11-25T19:38:46.986ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
83642024-11-25T19:38:46.986ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c041e1e6-e0fe-4790-95fd-23a8f7c04a8f", "content-length": "1", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
83652024-11-25T19:38:46.989ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83662024-11-25T19:38:46.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83672024-11-25T19:38:46.991ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 141.827133ms iteration = 16 status = null
83682024-11-25T19:38:47.002ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 152.270027ms iteration = 16 status = {}
83692024-11-25T19:38:47.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = de1ded99-c84a-4b21-8025-7456d2b7a864 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
83702024-11-25T19:38:47.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = de1ded99-c84a-4b21-8025-7456d2b7a864 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
83712024-11-25T19:38:47.011ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
83722024-11-25T19:38:47.011ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83732024-11-25T19:38:47.012ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6412e56-00ce-43c9-90b8-93ee5c4f1593", "content-length": "372", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
83742024-11-25T19:38:47.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83752024-11-25T19:38:47.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83762024-11-25T19:38:47.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = de1ded99-c84a-4b21-8025-7456d2b7a864 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
83772024-11-25T19:38:47.028ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
83782024-11-25T19:38:47.028ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
83792024-11-25T19:38:47.029ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "374fb775-8cfb-4a02-b5a9-4aeb65dcd007", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
83802024-11-25T19:38:47.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83812024-11-25T19:38:47.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83822024-11-25T19:38:47.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83832024-11-25T19:38:47.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83842024-11-25T19:38:47.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83852024-11-25T19:38:47.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83862024-11-25T19:38:47.038ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
83872024-11-25T19:38:47.038ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83882024-11-25T19:38:47.039ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cf048a28-1daa-4485-a6e0-8db76cb6e21f", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
83892024-11-25T19:38:47.041ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 191.380294ms iteration = 16 status = {}
83902024-11-25T19:38:47.077ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83912024-11-25T19:38:47.077ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83922024-11-25T19:38:47.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83932024-11-25T19:38:47.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83942024-11-25T19:38:47.079ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
83952024-11-25T19:38:47.079ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83962024-11-25T19:38:47.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83972024-11-25T19:38:47.080ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83982024-11-25T19:38:47.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83992024-11-25T19:38:47.082ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84002024-11-25T19:38:47.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84012024-11-25T19:38:47.088ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84022024-11-25T19:38:47.092ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84032024-11-25T19:38:47.092ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84042024-11-25T19:38:47.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84052024-11-25T19:38:47.094ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
84062024-11-25T19:38:47.094ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad1f7eb1-15e8-4ce2-84f5-e3e3ea7c1b2b", "content-length": "134", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
84072024-11-25T19:38:47.094ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
84082024-11-25T19:38:47.094ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
84092024-11-25T19:38:47.094ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
84102024-11-25T19:38:47.094ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
84112024-11-25T19:38:47.094ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84122024-11-25T19:38:47.094ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84132024-11-25T19:38:47.094ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84142024-11-25T19:38:47.094ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84152024-11-25T19:38:47.095ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84162024-11-25T19:38:47.095ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84172024-11-25T19:38:47.095ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
84182024-11-25T19:38:47.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84192024-11-25T19:38:47.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84202024-11-25T19:38:47.098ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
84212024-11-25T19:38:47.098ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5cb17f2-1902-4cc7-8297-f07dbf650c33", "content-length": "2", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
84222024-11-25T19:38:47.098ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
84232024-11-25T19:38:47.098ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5739bada-1c3e-48d8-8800-ebab01df06e0", "content-length": "51", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
84242024-11-25T19:38:47.098ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
84252024-11-25T19:38:47.098ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
84262024-11-25T19:38:47.142ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
84272024-11-25T19:38:47.210ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ff7cf100-98ca-4f51-9cd8-ff88a69dacf4", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
84282024-11-25T19:38:47.210ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
84292024-11-25T19:38:47.210ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
84302024-11-25T19:38:47.210ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e91dc8b-32e3-4981-a104-4e40320ea7c5", "content-length": "682", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
84312024-11-25T19:38:47.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84322024-11-25T19:38:47.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84332024-11-25T19:38:47.210ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7cc658c-47f8-47ff-8e83-ea0e8ded8ae4", "content-length": "691", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
84342024-11-25T19:38:47.210ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
84352024-11-25T19:38:47.210ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
84362024-11-25T19:38:47.210ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
84372024-11-25T19:38:47.213ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 363.190226ms iteration = 16 status = {}
84382024-11-25T19:38:47.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84392024-11-25T19:38:47.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84402024-11-25T19:38:47.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84412024-11-25T19:38:47.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84422024-11-25T19:38:47.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84432024-11-25T19:38:47.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84442024-11-25T19:38:47.228ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 378.794752ms iteration = 16 status = {}
84452024-11-25T19:38:47.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 355c4b1a-135a-42a8-868c-ae284ba8482c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
84462024-11-25T19:38:47.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 355c4b1a-135a-42a8-868c-ae284ba8482c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
84472024-11-25T19:38:47.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 355c4b1a-135a-42a8-868c-ae284ba8482c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
84482024-11-25T19:38:48.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4ebeee3b-ea02-45ee-acd2-dcfaa4504e3f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84492024-11-25T19:38:48.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4ebeee3b-ea02-45ee-acd2-dcfaa4504e3f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84502024-11-25T19:38:48.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4ebeee3b-ea02-45ee-acd2-dcfaa4504e3f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84512024-11-25T19:38:49.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8f58f41b-d734-4b7e-98c0-ed2ebbc0e892 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84522024-11-25T19:38:49.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8f58f41b-d734-4b7e-98c0-ed2ebbc0e892 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84532024-11-25T19:38:49.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8f58f41b-d734-4b7e-98c0-ed2ebbc0e892 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84542024-11-25T19:38:50.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a815f608-e568-4725-9b1b-1b9d42791036 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84552024-11-25T19:38:50.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a815f608-e568-4725-9b1b-1b9d42791036 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84562024-11-25T19:38:50.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a815f608-e568-4725-9b1b-1b9d42791036 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84572024-11-25T19:38:51.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5d5671c4-f92a-46a0-b9d1-9c966eb435c6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84582024-11-25T19:38:51.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5d5671c4-f92a-46a0-b9d1-9c966eb435c6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84592024-11-25T19:38:51.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5d5671c4-f92a-46a0-b9d1-9c966eb435c6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84602024-11-25T19:38:52.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f04323e2-521b-4512-9907-7f7d56e429b1 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84612024-11-25T19:38:52.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f04323e2-521b-4512-9907-7f7d56e429b1 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84622024-11-25T19:38:52.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f04323e2-521b-4512-9907-7f7d56e429b1 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84632024-11-25T19:38:52.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 795 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 70092176-3454-4599-8afc-bee9ccabe37d response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
84642024-11-25T19:38:53.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8989d0e9-34f5-47b8-98d4-614e3c054435 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84652024-11-25T19:38:53.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8989d0e9-34f5-47b8-98d4-614e3c054435 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84662024-11-25T19:38:53.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8989d0e9-34f5-47b8-98d4-614e3c054435 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84672024-11-25T19:38:54.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3fba95ea-a12f-4867-b600-352d04a9cf30 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84682024-11-25T19:38:54.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3fba95ea-a12f-4867-b600-352d04a9cf30 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84692024-11-25T19:38:54.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3fba95ea-a12f-4867-b600-352d04a9cf30 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84702024-11-25T19:38:55.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 72f57aa6-2913-4934-a62f-6f8d47afecf0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84712024-11-25T19:38:55.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 72f57aa6-2913-4934-a62f-6f8d47afecf0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84722024-11-25T19:38:55.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 72f57aa6-2913-4934-a62f-6f8d47afecf0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84732024-11-25T19:38:56.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 09f0c566-5794-42be-a691-de9e8302bfcd roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84742024-11-25T19:38:56.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 09f0c566-5794-42be-a691-de9e8302bfcd resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84752024-11-25T19:38:56.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 09f0c566-5794-42be-a691-de9e8302bfcd response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84762024-11-25T19:38:56.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
84772024-11-25T19:38:56.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84782024-11-25T19:38:56.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
84792024-11-25T19:38:56.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84802024-11-25T19:38:56.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84812024-11-25T19:38:56.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84822024-11-25T19:38:56.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84832024-11-25T19:38:56.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84842024-11-25T19:38:56.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84852024-11-25T19:38:56.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84862024-11-25T19:38:56.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84872024-11-25T19:38:56.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84882024-11-25T19:38:56.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84892024-11-25T19:38:56.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
84902024-11-25T19:38:56.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84912024-11-25T19:38:56.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84922024-11-25T19:38:56.868ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
84932024-11-25T19:38:56.868ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.119395ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
84942024-11-25T19:38:56.876ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84952024-11-25T19:38:56.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84962024-11-25T19:38:56.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.04405ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84972024-11-25T19:38:57.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b40c92a3-3a8b-4b48-a2ac-d00a05ed9373 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84982024-11-25T19:38:57.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b40c92a3-3a8b-4b48-a2ac-d00a05ed9373 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
84992024-11-25T19:38:57.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b40c92a3-3a8b-4b48-a2ac-d00a05ed9373 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85002024-11-25T19:38:58.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e38b39a4-17c3-478e-8028-3c21aa23e3dc roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85012024-11-25T19:38:58.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e38b39a4-17c3-478e-8028-3c21aa23e3dc resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85022024-11-25T19:38:58.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e38b39a4-17c3-478e-8028-3c21aa23e3dc response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85032024-11-25T19:38:59.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 728b8119-a4c1-410d-b011-436abe426b2e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85042024-11-25T19:38:59.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 728b8119-a4c1-410d-b011-436abe426b2e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85052024-11-25T19:38:59.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 728b8119-a4c1-410d-b011-436abe426b2e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85062024-11-25T19:39:00.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a41c99d2-6c19-4870-a5ec-6f081237be0a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85072024-11-25T19:39:00.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a41c99d2-6c19-4870-a5ec-6f081237be0a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85082024-11-25T19:39:00.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a41c99d2-6c19-4870-a5ec-6f081237be0a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85092024-11-25T19:39:01.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d37ce535-c72a-4170-87ea-f214406c5d86 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85102024-11-25T19:39:01.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d37ce535-c72a-4170-87ea-f214406c5d86 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85112024-11-25T19:39:01.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d37ce535-c72a-4170-87ea-f214406c5d86 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85122024-11-25T19:39:02.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 658 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = ae2506ef-b608-4e30-b391-5dbadda73ad2 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
85132024-11-25T19:39:02.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5aaa0764-0bc7-4ab8-a6d4-637970d5bcd9 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85142024-11-25T19:39:02.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5aaa0764-0bc7-4ab8-a6d4-637970d5bcd9 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85152024-11-25T19:39:02.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5aaa0764-0bc7-4ab8-a6d4-637970d5bcd9 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85162024-11-25T19:39:03.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b529b4a7-75f0-481a-b939-607363b5771d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85172024-11-25T19:39:03.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b529b4a7-75f0-481a-b939-607363b5771d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85182024-11-25T19:39:03.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b529b4a7-75f0-481a-b939-607363b5771d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85192024-11-25T19:39:04.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b3b094e0-0295-4256-b572-ab7454606208 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85202024-11-25T19:39:04.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b3b094e0-0295-4256-b572-ab7454606208 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85212024-11-25T19:39:04.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b3b094e0-0295-4256-b572-ab7454606208 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85222024-11-25T19:39:05.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ead0cd1b-7dd5-4eea-b188-74c162f16564 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85232024-11-25T19:39:05.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ead0cd1b-7dd5-4eea-b188-74c162f16564 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85242024-11-25T19:39:05.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ead0cd1b-7dd5-4eea-b188-74c162f16564 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85252024-11-25T19:39:06.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3fd93f18-58cb-40c5-997d-18d5c62470b2 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85262024-11-25T19:39:06.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3fd93f18-58cb-40c5-997d-18d5c62470b2 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85272024-11-25T19:39:06.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3fd93f18-58cb-40c5-997d-18d5c62470b2 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85282024-11-25T19:39:06.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
85292024-11-25T19:39:06.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85302024-11-25T19:39:06.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
85312024-11-25T19:39:06.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85322024-11-25T19:39:06.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85332024-11-25T19:39:06.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85342024-11-25T19:39:06.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85352024-11-25T19:39:06.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85362024-11-25T19:39:06.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85372024-11-25T19:39:06.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85382024-11-25T19:39:06.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85392024-11-25T19:39:06.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85402024-11-25T19:39:06.879ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85412024-11-25T19:39:06.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85422024-11-25T19:39:06.880ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.107121ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85432024-11-25T19:39:06.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85442024-11-25T19:39:06.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
85452024-11-25T19:39:06.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85462024-11-25T19:39:06.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85472024-11-25T19:39:06.898ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
85482024-11-25T19:39:06.898ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.852828ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
85492024-11-25T19:39:07.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 2f4d4ffa-90ab-4ded-ad9e-90465ea6690a roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
85502024-11-25T19:39:07.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 2f4d4ffa-90ab-4ded-ad9e-90465ea6690a resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
85512024-11-25T19:39:07.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 2f4d4ffa-90ab-4ded-ad9e-90465ea6690a response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
85522024-11-25T19:39:07.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 1f32b779-349d-468e-a276-0856cbc29e68 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
85532024-11-25T19:39:07.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 1f32b779-349d-468e-a276-0856cbc29e68 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
85542024-11-25T19:39:07.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 1f32b779-349d-468e-a276-0856cbc29e68 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
85552024-11-25T19:39:07.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 954b504c-5180-47a2-8f50-f3628c94e82d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85562024-11-25T19:39:07.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 954b504c-5180-47a2-8f50-f3628c94e82d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85572024-11-25T19:39:07.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 954b504c-5180-47a2-8f50-f3628c94e82d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85582024-11-25T19:39:08.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0e3f1bd8-247e-4b23-94c5-84e8c15e2afd roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85592024-11-25T19:39:08.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0e3f1bd8-247e-4b23-94c5-84e8c15e2afd resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85602024-11-25T19:39:08.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0e3f1bd8-247e-4b23-94c5-84e8c15e2afd response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85612024-11-25T19:39:09.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cad7447f-00e1-4b2d-9f56-a7e78e9421bc roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85622024-11-25T19:39:09.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cad7447f-00e1-4b2d-9f56-a7e78e9421bc resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85632024-11-25T19:39:09.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cad7447f-00e1-4b2d-9f56-a7e78e9421bc response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85642024-11-25T19:39:10.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 20bfe4f1-cf31-4ad0-b714-1891ccbe5e8f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85652024-11-25T19:39:10.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 20bfe4f1-cf31-4ad0-b714-1891ccbe5e8f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85662024-11-25T19:39:10.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 20bfe4f1-cf31-4ad0-b714-1891ccbe5e8f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85672024-11-25T19:39:11.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6866a57e-e524-48b9-9841-174dbcb3c472 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85682024-11-25T19:39:11.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6866a57e-e524-48b9-9841-174dbcb3c472 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85692024-11-25T19:39:11.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6866a57e-e524-48b9-9841-174dbcb3c472 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85702024-11-25T19:39:12.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 487 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 9ab1e416-05a3-4331-ab2c-66a273e953e6 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
85712024-11-25T19:39:12.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1a39c1dd-f6e3-4ded-8489-090f7790bc2c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85722024-11-25T19:39:12.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1a39c1dd-f6e3-4ded-8489-090f7790bc2c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85732024-11-25T19:39:12.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1a39c1dd-f6e3-4ded-8489-090f7790bc2c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85742024-11-25T19:39:13.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 666a469b-00fc-43b0-9b11-c56c9acd710d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85752024-11-25T19:39:13.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 666a469b-00fc-43b0-9b11-c56c9acd710d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85762024-11-25T19:39:13.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 666a469b-00fc-43b0-9b11-c56c9acd710d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85772024-11-25T19:39:14.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0d12c86c-3fc4-47fd-9df0-d49b78962326 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85782024-11-25T19:39:14.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0d12c86c-3fc4-47fd-9df0-d49b78962326 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85792024-11-25T19:39:14.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0d12c86c-3fc4-47fd-9df0-d49b78962326 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85802024-11-25T19:39:15.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7a007134-cd25-422e-b1b8-c1f227d41fad roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85812024-11-25T19:39:15.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7a007134-cd25-422e-b1b8-c1f227d41fad resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85822024-11-25T19:39:15.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7a007134-cd25-422e-b1b8-c1f227d41fad response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85832024-11-25T19:39:16.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 59eeaa9a-6ac0-439c-80ca-6d8070e70aa7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
85842024-11-25T19:39:16.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 59eeaa9a-6ac0-439c-80ca-6d8070e70aa7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
85852024-11-25T19:39:16.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 59eeaa9a-6ac0-439c-80ca-6d8070e70aa7 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
85862024-11-25T19:39:16.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c8c00e91-73e2-4197-b28d-36a3222df496 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85872024-11-25T19:39:16.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c8c00e91-73e2-4197-b28d-36a3222df496 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85882024-11-25T19:39:16.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c8c00e91-73e2-4197-b28d-36a3222df496 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
85892024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
85902024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
85912024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85922024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
85932024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
85942024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
85952024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
85962024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85972024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85982024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
85992024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
86002024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86012024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
86022024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
86032024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86042024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
86052024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
86062024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
86072024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86082024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
86092024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
86102024-11-25T19:39:16.850ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
86112024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
86122024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
86132024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86142024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
86152024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
86162024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
86172024-11-25T19:39:16.850ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:29:16.850210220 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
86182024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
86192024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
86202024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
86212024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86222024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
86232024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86242024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
86252024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
86262024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
86272024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86282024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
86292024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86302024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
86312024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
86322024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86332024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
86342024-11-25T19:39:16.850ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
86352024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.65\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
86362024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
86372024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
86382024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86392024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
86402024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
86412024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
86422024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
86432024-11-25T19:39:16.850ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
86442024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86452024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
86462024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
86472024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86482024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
86492024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
86502024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86512024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86522024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
86532024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86542024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86552024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
86562024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
86572024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86582024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86592024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
86602024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
86612024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86622024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
86632024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86642024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
86652024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86662024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
86672024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86682024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86692024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86702024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86712024-11-25T19:39:16.850ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1582, tv_nsec: 395733550 } })
86722024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86732024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86742024-11-25T19:39:16.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86752024-11-25T19:39:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
86762024-11-25T19:39:16.851ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1582, tv_nsec: 395851872 } })
86772024-11-25T19:39:16.851ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
86782024-11-25T19:39:16.851ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.151763ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
86792024-11-25T19:39:16.851ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
86802024-11-25T19:39:16.851ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.344207ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
86812024-11-25T19:39:16.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.131391ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
86822024-11-25T19:39:16.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86832024-11-25T19:39:16.854ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.665732ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
86842024-11-25T19:39:16.855ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1582, tv_nsec: 399909532 } })
86852024-11-25T19:39:16.855ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
86862024-11-25T19:39:16.855ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1582, tv_nsec: 400295700 } })
86872024-11-25T19:39:16.855ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
86882024-11-25T19:39:16.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86892024-11-25T19:39:16.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86902024-11-25T19:39:16.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86912024-11-25T19:39:16.857ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86922024-11-25T19:39:16.858ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86932024-11-25T19:39:16.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86942024-11-25T19:39:16.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86952024-11-25T19:39:16.859ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:29:16.850210220 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
86962024-11-25T19:39:16.859ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.495737ms iteration = 9 status = {"expiration":"2024-11-25T19:29:16.850210220Z","pruned":[]}
86972024-11-25T19:39:16.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
86982024-11-25T19:39:16.860ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
86992024-11-25T19:39:16.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87002024-11-25T19:39:16.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
87012024-11-25T19:39:16.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87022024-11-25T19:39:16.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87032024-11-25T19:39:16.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87042024-11-25T19:39:16.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87052024-11-25T19:39:16.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87062024-11-25T19:39:16.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87072024-11-25T19:39:16.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
87082024-11-25T19:39:16.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87092024-11-25T19:39:16.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87102024-11-25T19:39:16.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
87112024-11-25T19:39:16.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87122024-11-25T19:39:16.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87132024-11-25T19:39:16.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 20.199377ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
87142024-11-25T19:39:16.871ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.810948ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
87152024-11-25T19:39:16.871ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87162024-11-25T19:39:16.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87172024-11-25T19:39:16.871ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87182024-11-25T19:39:16.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87192024-11-25T19:39:16.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87202024-11-25T19:39:16.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
87212024-11-25T19:39:16.877ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87222024-11-25T19:39:16.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87232024-11-25T19:39:16.885ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1582, tv_nsec: 429968842 } })
87242024-11-25T19:39:16.885ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
87252024-11-25T19:39:16.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87262024-11-25T19:39:16.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87272024-11-25T19:39:16.899ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87282024-11-25T19:39:16.899ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
87292024-11-25T19:39:16.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87302024-11-25T19:39:16.899ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 49.691625ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87312024-11-25T19:39:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87322024-11-25T19:39:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87332024-11-25T19:39:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87342024-11-25T19:39:16.902ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87352024-11-25T19:39:16.902ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
87362024-11-25T19:39:16.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87372024-11-25T19:39:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87382024-11-25T19:39:16.903ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
87392024-11-25T19:39:16.903ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
87402024-11-25T19:39:16.903ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 53.115362ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
87412024-11-25T19:39:16.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87422024-11-25T19:39:16.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87432024-11-25T19:39:16.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87442024-11-25T19:39:16.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87452024-11-25T19:39:16.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87462024-11-25T19:39:16.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87472024-11-25T19:39:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
87482024-11-25T19:39:16.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 58.243833ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
87492024-11-25T19:39:16.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87502024-11-25T19:39:16.910ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
87512024-11-25T19:39:16.910ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
87522024-11-25T19:39:16.910ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 60.495976ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
87532024-11-25T19:39:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87542024-11-25T19:39:16.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87552024-11-25T19:39:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87562024-11-25T19:39:16.911ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
87572024-11-25T19:39:16.911ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.750491ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
87582024-11-25T19:39:16.911ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87592024-11-25T19:39:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87602024-11-25T19:39:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87612024-11-25T19:39:16.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87622024-11-25T19:39:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87632024-11-25T19:39:16.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87642024-11-25T19:39:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87652024-11-25T19:39:16.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87662024-11-25T19:39:16.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87672024-11-25T19:39:16.922ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
87682024-11-25T19:39:16.922ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
87692024-11-25T19:39:16.922ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
87702024-11-25T19:39:16.922ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87712024-11-25T19:39:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87722024-11-25T19:39:16.923ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87732024-11-25T19:39:16.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87742024-11-25T19:39:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87752024-11-25T19:39:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
87762024-11-25T19:39:16.924ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87772024-11-25T19:39:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87782024-11-25T19:39:16.924ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87792024-11-25T19:39:16.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87802024-11-25T19:39:16.926ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
87812024-11-25T19:39:16.926ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87822024-11-25T19:39:16.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87832024-11-25T19:39:16.928ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87842024-11-25T19:39:16.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
87852024-11-25T19:39:16.928ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87862024-11-25T19:39:16.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87872024-11-25T19:39:16.930ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87882024-11-25T19:39:16.930ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87892024-11-25T19:39:16.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87902024-11-25T19:39:16.931ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87912024-11-25T19:39:16.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87922024-11-25T19:39:16.935ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
87932024-11-25T19:39:16.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
87942024-11-25T19:39:16.936ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87952024-11-25T19:39:16.936ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
87962024-11-25T19:39:16.936ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 86.359094ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
87972024-11-25T19:39:16.946ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87982024-11-25T19:39:16.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87992024-11-25T19:39:16.948ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
88002024-11-25T19:39:16.948ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
88012024-11-25T19:39:16.948ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
88022024-11-25T19:39:16.948ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88032024-11-25T19:39:16.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88042024-11-25T19:39:16.948ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 98.433221ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
88052024-11-25T19:39:16.952ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88062024-11-25T19:39:16.952ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88072024-11-25T19:39:16.952ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
88082024-11-25T19:39:16.952ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 102.820247ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
88092024-11-25T19:39:16.955ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.365217ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88102024-11-25T19:39:16.956ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 106.01664ms iteration = 19 status = {"physical_disks_added":0}
88112024-11-25T19:39:16.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
88122024-11-25T19:39:16.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88132024-11-25T19:39:16.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88142024-11-25T19:39:16.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88152024-11-25T19:39:16.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88162024-11-25T19:39:16.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88172024-11-25T19:39:16.958ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 108.152942ms iteration = 17 status = 0
88182024-11-25T19:39:16.975ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
88192024-11-25T19:39:16.975ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
88202024-11-25T19:39:16.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88212024-11-25T19:39:16.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88222024-11-25T19:39:16.978ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88232024-11-25T19:39:16.981ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
88242024-11-25T19:39:16.981ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88252024-11-25T19:39:16.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88262024-11-25T19:39:16.989ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
88272024-11-25T19:39:16.992ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
88282024-11-25T19:39:16.992ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
88292024-11-25T19:39:16.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88302024-11-25T19:39:16.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88312024-11-25T19:39:16.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88322024-11-25T19:39:16.997ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
88332024-11-25T19:39:16.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88342024-11-25T19:39:17.004ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
88352024-11-25T19:39:17.004ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88362024-11-25T19:39:17.004ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eda03e8f-e0dc-46c7-9bb4-cfd50c72f02e", "content-length": "26", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
88372024-11-25T19:39:17.004ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88382024-11-25T19:39:17.006ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88392024-11-25T19:39:17.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88402024-11-25T19:39:17.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88412024-11-25T19:39:17.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88422024-11-25T19:39:17.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88432024-11-25T19:39:17.012ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88442024-11-25T19:39:17.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88452024-11-25T19:39:17.013ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
88462024-11-25T19:39:17.013ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
88472024-11-25T19:39:17.013ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
88482024-11-25T19:39:17.013ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 163.66864ms iteration = 9 status = {"generation":1}
88492024-11-25T19:39:17.014ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88502024-11-25T19:39:17.016ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
88512024-11-25T19:39:17.016ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88522024-11-25T19:39:17.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88532024-11-25T19:39:17.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88542024-11-25T19:39:17.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88552024-11-25T19:39:17.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88562024-11-25T19:39:17.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88572024-11-25T19:39:17.031ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
88582024-11-25T19:39:17.032ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 181.919179ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
88592024-11-25T19:39:17.106ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88602024-11-25T19:39:17.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88612024-11-25T19:39:17.110ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
88622024-11-25T19:39:17.110ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88632024-11-25T19:39:17.110ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cde22da3-0281-47bd-97b0-ffac2c6ccbea", "content-length": "26", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
88642024-11-25T19:39:17.110ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88652024-11-25T19:39:17.112ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88662024-11-25T19:39:17.162ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
88672024-11-25T19:39:17.162ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88682024-11-25T19:39:17.162ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7b953c6-07e5-498f-8bf7-c214901c936b", "content-length": "26", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
88692024-11-25T19:39:17.162ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88702024-11-25T19:39:17.164ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
88712024-11-25T19:39:17.172ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
88722024-11-25T19:39:17.172ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88732024-11-25T19:39:17.172ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3af38a9d-bf05-4bfa-b227-81011f44755c", "content-length": "372", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
88742024-11-25T19:39:17.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88752024-11-25T19:39:17.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88762024-11-25T19:39:17.175ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88772024-11-25T19:39:17.175ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
88782024-11-25T19:39:17.175ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
88792024-11-25T19:39:17.175ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
88802024-11-25T19:39:17.175ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 324.757181ms iteration = 9 status = {"generation":2}
88812024-11-25T19:39:17.177ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
88822024-11-25T19:39:17.177ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88832024-11-25T19:39:17.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88842024-11-25T19:39:17.179ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88852024-11-25T19:39:17.180ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
88862024-11-25T19:39:17.182ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
88872024-11-25T19:39:17.182ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88882024-11-25T19:39:17.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88892024-11-25T19:39:17.214ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
88902024-11-25T19:39:17.214ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 363.808988ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
88912024-11-25T19:39:17.229ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
88922024-11-25T19:39:17.229ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
88932024-11-25T19:39:17.229ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "dcc6013e-e9cc-4ba9-afb5-81f65d89bb73", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
88942024-11-25T19:39:17.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88952024-11-25T19:39:17.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88962024-11-25T19:39:17.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88972024-11-25T19:39:17.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88982024-11-25T19:39:17.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88992024-11-25T19:39:17.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89002024-11-25T19:39:17.239ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
89012024-11-25T19:39:17.239ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89022024-11-25T19:39:17.240ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9e6e563e-6738-4537-888b-ab31a0c50ef0", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
89032024-11-25T19:39:17.241ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 391.334918ms iteration = 17 status = {}
89042024-11-25T19:39:17.286ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
89052024-11-25T19:39:17.287ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f0f3144-82b1-4173-914b-fc2dffbcecc1", "content-length": "1", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
89062024-11-25T19:39:17.288ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89072024-11-25T19:39:17.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89082024-11-25T19:39:17.291ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 440.966831ms iteration = 17 status = null
89092024-11-25T19:39:17.301ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
89102024-11-25T19:39:17.302ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2c996370-a7ce-43fb-b22e-54c4753c9c48", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89112024-11-25T19:39:17.302ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89122024-11-25T19:39:17.304ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6abd3861-2deb-4cc4-8958-1ec791969a99", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89132024-11-25T19:39:17.304ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89142024-11-25T19:39:17.306ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89152024-11-25T19:39:17.306ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 456.053818ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
89162024-11-25T19:39:17.311ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 461.406322ms iteration = 17 status = {}
89172024-11-25T19:39:17.327ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
89182024-11-25T19:39:17.328ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "52ca96fb-c4c2-42dc-86e3-22001a343e3a", "date": "Mon, 25 Nov 2024 19:39:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
89192024-11-25T19:39:17.328ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
89202024-11-25T19:39:17.330ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "fcd77cdf-52d6-4e3c-95c8-817ff8ab6293", "date": "Mon, 25 Nov 2024 19:39:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
89212024-11-25T19:39:17.330ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
89222024-11-25T19:39:17.331ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
89232024-11-25T19:39:17.331ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c8f79c6b-42aa-4807-9cd2-36e852e672ac", "date": "Mon, 25 Nov 2024 19:39:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
89242024-11-25T19:39:17.331ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
89252024-11-25T19:39:17.332ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc82fa6f-969e-44d0-8759-659424768ae8", "content-length": "691", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
89262024-11-25T19:39:17.332ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
89272024-11-25T19:39:17.332ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
89282024-11-25T19:39:17.332ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
89292024-11-25T19:39:17.334ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 484.136359ms iteration = 17 status = {}
89302024-11-25T19:39:17.334ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
89312024-11-25T19:39:17.334ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 484.150469ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
89322024-11-25T19:39:17.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89332024-11-25T19:39:17.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89342024-11-25T19:39:17.408ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
89352024-11-25T19:39:17.408ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89362024-11-25T19:39:17.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89372024-11-25T19:39:17.417ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
89382024-11-25T19:39:17.418ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a09ee2c2-d1ed-465e-a016-fb8c20a01702", "content-length": "134", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
89392024-11-25T19:39:17.418ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
89402024-11-25T19:39:17.418ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
89412024-11-25T19:39:17.419ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
89422024-11-25T19:39:17.419ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
89432024-11-25T19:39:17.419ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89442024-11-25T19:39:17.419ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89452024-11-25T19:39:17.419ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89462024-11-25T19:39:17.419ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89472024-11-25T19:39:17.419ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89482024-11-25T19:39:17.419ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89492024-11-25T19:39:17.420ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
89502024-11-25T19:39:17.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89512024-11-25T19:39:17.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89522024-11-25T19:39:17.422ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
89532024-11-25T19:39:17.422ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4dba32b-3123-4b5b-ac47-395ef2670532", "content-length": "2", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
89542024-11-25T19:39:17.422ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
89552024-11-25T19:39:17.422ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "73d68922-7fb6-49f1-bf5d-7e38b5dc20b3", "content-length": "51", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
89562024-11-25T19:39:17.422ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
89572024-11-25T19:39:17.422ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
89582024-11-25T19:39:17.512ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "39f8d68a-f055-4c98-b7af-24a46f6bb388", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
89592024-11-25T19:39:17.512ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
89602024-11-25T19:39:17.512ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
89612024-11-25T19:39:17.512ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a8a1141-c6bc-44b2-97d4-994869ee6eb5", "content-length": "682", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
89622024-11-25T19:39:17.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89632024-11-25T19:39:17.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89642024-11-25T19:39:17.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89652024-11-25T19:39:17.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89662024-11-25T19:39:17.521ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89672024-11-25T19:39:17.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89682024-11-25T19:39:17.523ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89692024-11-25T19:39:17.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89702024-11-25T19:39:17.530ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 680.632634ms iteration = 17 status = {}
89712024-11-25T19:39:17.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b2f0acde-2bba-4fff-9bf0-d50ba944856f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89722024-11-25T19:39:17.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b2f0acde-2bba-4fff-9bf0-d50ba944856f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89732024-11-25T19:39:17.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b2f0acde-2bba-4fff-9bf0-d50ba944856f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89742024-11-25T19:39:18.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 44c52dc7-9fc9-4ac9-b203-e367b48ca40c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89752024-11-25T19:39:18.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 44c52dc7-9fc9-4ac9-b203-e367b48ca40c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89762024-11-25T19:39:18.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 44c52dc7-9fc9-4ac9-b203-e367b48ca40c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89772024-11-25T19:39:19.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f03a66ef-6ddd-4b85-8dec-d998dace9678 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89782024-11-25T19:39:19.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f03a66ef-6ddd-4b85-8dec-d998dace9678 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89792024-11-25T19:39:19.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f03a66ef-6ddd-4b85-8dec-d998dace9678 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89802024-11-25T19:39:20.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3b2f0425-cc22-49eb-9e1a-3649f25cb25a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89812024-11-25T19:39:20.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3b2f0425-cc22-49eb-9e1a-3649f25cb25a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89822024-11-25T19:39:20.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3b2f0425-cc22-49eb-9e1a-3649f25cb25a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89832024-11-25T19:39:21.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c8918a99-04eb-4f18-8e90-f1b881164a52 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89842024-11-25T19:39:21.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c8918a99-04eb-4f18-8e90-f1b881164a52 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89852024-11-25T19:39:21.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c8918a99-04eb-4f18-8e90-f1b881164a52 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89862024-11-25T19:39:22.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 563 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = c943df2a-e1d9-402b-9b7d-35ec12294111 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
89872024-11-25T19:39:22.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = db0d5e70-da6d-4293-b1c4-b64868d87061 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89882024-11-25T19:39:22.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = db0d5e70-da6d-4293-b1c4-b64868d87061 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89892024-11-25T19:39:22.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = db0d5e70-da6d-4293-b1c4-b64868d87061 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89902024-11-25T19:39:23.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 92625535-1c1c-4ffc-a7ba-23ab759dfec6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89912024-11-25T19:39:23.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 92625535-1c1c-4ffc-a7ba-23ab759dfec6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89922024-11-25T19:39:23.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 92625535-1c1c-4ffc-a7ba-23ab759dfec6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89932024-11-25T19:39:24.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5022d6b8-ae0a-4019-a3ef-0fd94b86cff4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89942024-11-25T19:39:24.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5022d6b8-ae0a-4019-a3ef-0fd94b86cff4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89952024-11-25T19:39:24.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5022d6b8-ae0a-4019-a3ef-0fd94b86cff4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89962024-11-25T19:39:25.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7e322047-f159-4b0e-b269-d8c439bb897c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89972024-11-25T19:39:25.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7e322047-f159-4b0e-b269-d8c439bb897c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89982024-11-25T19:39:25.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7e322047-f159-4b0e-b269-d8c439bb897c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
89992024-11-25T19:39:26.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
90002024-11-25T19:39:26.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
90012024-11-25T19:39:26.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90022024-11-25T19:39:26.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90032024-11-25T19:39:26.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90042024-11-25T19:39:26.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90052024-11-25T19:39:26.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5f011f7a-3fed-42e9-9826-af7a11cfc3a1 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90062024-11-25T19:39:26.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5f011f7a-3fed-42e9-9826-af7a11cfc3a1 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90072024-11-25T19:39:26.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90082024-11-25T19:39:26.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90092024-11-25T19:39:26.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90102024-11-25T19:39:26.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1855 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5f011f7a-3fed-42e9-9826-af7a11cfc3a1 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90112024-11-25T19:39:26.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.167012ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90122024-11-25T19:39:26.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90132024-11-25T19:39:26.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90142024-11-25T19:39:26.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90152024-11-25T19:39:26.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90162024-11-25T19:39:26.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90172024-11-25T19:39:26.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90182024-11-25T19:39:26.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
90192024-11-25T19:39:26.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90202024-11-25T19:39:26.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90212024-11-25T19:39:26.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
90222024-11-25T19:39:26.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.329718ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
90232024-11-25T19:39:27.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8a561200-3897-4067-bc32-5abf972c9bdb roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90242024-11-25T19:39:27.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8a561200-3897-4067-bc32-5abf972c9bdb resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90252024-11-25T19:39:27.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8a561200-3897-4067-bc32-5abf972c9bdb response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90262024-11-25T19:39:28.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4b166f4f-c31f-41e7-ace7-9038edaacc20 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90272024-11-25T19:39:28.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4b166f4f-c31f-41e7-ace7-9038edaacc20 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90282024-11-25T19:39:28.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4b166f4f-c31f-41e7-ace7-9038edaacc20 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90292024-11-25T19:39:29.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6ff1aaaf-bf95-4709-93d9-5396353b4ea2 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90302024-11-25T19:39:29.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6ff1aaaf-bf95-4709-93d9-5396353b4ea2 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90312024-11-25T19:39:29.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6ff1aaaf-bf95-4709-93d9-5396353b4ea2 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90322024-11-25T19:39:30.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 409c43e1-e254-4335-a90d-fa94abbc4b9e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90332024-11-25T19:39:30.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 409c43e1-e254-4335-a90d-fa94abbc4b9e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90342024-11-25T19:39:30.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 409c43e1-e254-4335-a90d-fa94abbc4b9e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90352024-11-25T19:39:31.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e1ec2c93-3ee8-4f98-8d1b-3fecfaf319f7 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90362024-11-25T19:39:31.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e1ec2c93-3ee8-4f98-8d1b-3fecfaf319f7 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90372024-11-25T19:39:31.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e1ec2c93-3ee8-4f98-8d1b-3fecfaf319f7 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90382024-11-25T19:39:32.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 559 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 887ab3b9-4103-4fe0-8495-818e6e259588 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
90392024-11-25T19:39:32.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad6693ab-08d2-4d82-8102-b815388de497 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90402024-11-25T19:39:32.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad6693ab-08d2-4d82-8102-b815388de497 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90412024-11-25T19:39:32.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad6693ab-08d2-4d82-8102-b815388de497 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90422024-11-25T19:39:33.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0831f8d7-feb2-44a5-96a4-cc19b7df8596 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90432024-11-25T19:39:33.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0831f8d7-feb2-44a5-96a4-cc19b7df8596 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90442024-11-25T19:39:34.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0831f8d7-feb2-44a5-96a4-cc19b7df8596 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90452024-11-25T19:39:35.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = df7f7628-47e3-4cb0-b9ce-810aabddfc90 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90462024-11-25T19:39:35.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = df7f7628-47e3-4cb0-b9ce-810aabddfc90 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90472024-11-25T19:39:35.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = df7f7628-47e3-4cb0-b9ce-810aabddfc90 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90482024-11-25T19:39:36.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0494fb4f-8dc4-4f32-a9ba-196d8cca6fa6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90492024-11-25T19:39:36.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0494fb4f-8dc4-4f32-a9ba-196d8cca6fa6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90502024-11-25T19:39:36.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0494fb4f-8dc4-4f32-a9ba-196d8cca6fa6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90512024-11-25T19:39:36.849ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
90522024-11-25T19:39:36.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90532024-11-25T19:39:36.850ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
90542024-11-25T19:39:36.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90552024-11-25T19:39:36.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90562024-11-25T19:39:36.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90572024-11-25T19:39:36.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90582024-11-25T19:39:36.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90592024-11-25T19:39:36.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90602024-11-25T19:39:36.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.773154ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90612024-11-25T19:39:36.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90622024-11-25T19:39:36.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90632024-11-25T19:39:36.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90642024-11-25T19:39:36.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90652024-11-25T19:39:36.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90662024-11-25T19:39:36.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90672024-11-25T19:39:36.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
90682024-11-25T19:39:36.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90692024-11-25T19:39:36.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90702024-11-25T19:39:36.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
90712024-11-25T19:39:36.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.382629ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
90722024-11-25T19:39:37.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f7bdb74b-1581-45ec-882f-63c3ced2fd40 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90732024-11-25T19:39:37.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f7bdb74b-1581-45ec-882f-63c3ced2fd40 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90742024-11-25T19:39:37.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f7bdb74b-1581-45ec-882f-63c3ced2fd40 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90752024-11-25T19:39:38.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a34d5aee-2673-4ced-b022-74bf16aa5b10 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90762024-11-25T19:39:38.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a34d5aee-2673-4ced-b022-74bf16aa5b10 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90772024-11-25T19:39:38.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a34d5aee-2673-4ced-b022-74bf16aa5b10 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90782024-11-25T19:39:39.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8b725a52-6782-438c-9428-d66821f5cfbd roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90792024-11-25T19:39:39.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8b725a52-6782-438c-9428-d66821f5cfbd resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90802024-11-25T19:39:39.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8b725a52-6782-438c-9428-d66821f5cfbd response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90812024-11-25T19:39:40.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2d043236-b321-4727-af97-39ad3c588269 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90822024-11-25T19:39:40.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2d043236-b321-4727-af97-39ad3c588269 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90832024-11-25T19:39:40.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2d043236-b321-4727-af97-39ad3c588269 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90842024-11-25T19:39:41.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cb0bbe44-0019-4c84-9bf8-a054b335477b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90852024-11-25T19:39:41.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cb0bbe44-0019-4c84-9bf8-a054b335477b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90862024-11-25T19:39:41.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cb0bbe44-0019-4c84-9bf8-a054b335477b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90872024-11-25T19:39:42.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 522b3bc2-f108-4286-9ad1-3bd04e6904d6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90882024-11-25T19:39:42.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 522b3bc2-f108-4286-9ad1-3bd04e6904d6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90892024-11-25T19:39:42.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 522b3bc2-f108-4286-9ad1-3bd04e6904d6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90902024-11-25T19:39:42.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 469 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = a55ac822-e2cd-44e4-8f70-d958b14faad1 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
90912024-11-25T19:39:43.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6b4e3b2d-e8bb-4648-a1f8-943dc365f59a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90922024-11-25T19:39:43.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6b4e3b2d-e8bb-4648-a1f8-943dc365f59a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90932024-11-25T19:39:43.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6b4e3b2d-e8bb-4648-a1f8-943dc365f59a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90942024-11-25T19:39:44.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1b32f879-563f-43c5-8036-825669db5306 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90952024-11-25T19:39:44.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1b32f879-563f-43c5-8036-825669db5306 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90962024-11-25T19:39:44.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2586 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1b32f879-563f-43c5-8036-825669db5306 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90972024-11-25T19:39:45.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4fc76b1c-ba6d-4dca-8219-499d7e095b95 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90982024-11-25T19:39:45.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4fc76b1c-ba6d-4dca-8219-499d7e095b95 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
90992024-11-25T19:39:45.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4fc76b1c-ba6d-4dca-8219-499d7e095b95 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
91002024-11-25T19:39:46.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0a451018-7f1e-41fd-b498-334fe706c6b1 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
91012024-11-25T19:39:46.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0a451018-7f1e-41fd-b498-334fe706c6b1 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
91022024-11-25T19:39:46.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0a451018-7f1e-41fd-b498-334fe706c6b1 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
91032024-11-25T19:39:46.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = b13bd665-b4f8-461d-b85e-16929763428a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
91042024-11-25T19:39:46.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = b13bd665-b4f8-461d-b85e-16929763428a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
91052024-11-25T19:39:46.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = b13bd665-b4f8-461d-b85e-16929763428a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
91062024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
91072024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
91082024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
91092024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91102024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
91112024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
91122024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
91132024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91142024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
91152024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
91162024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
91172024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
91182024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91192024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
91202024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91212024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
91222024-11-25T19:39:46.850ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
91232024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
91242024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91252024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
91262024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91272024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91282024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
91292024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91302024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
91312024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
91322024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
91332024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
91342024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91352024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
91362024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
91372024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
91382024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
91392024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
91402024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91412024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
91422024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
91432024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
91442024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
91452024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91462024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91472024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91482024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91492024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91502024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91512024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
91522024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
91532024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91542024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
91552024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
91562024-11-25T19:39:46.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
91572024-11-25T19:39:46.853ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1612, tv_nsec: 397766480 } })
91582024-11-25T19:39:46.853ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.05773ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
91592024-11-25T19:39:46.853ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
91602024-11-25T19:39:46.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1612, tv_nsec: 398729869 } })
91612024-11-25T19:39:46.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91622024-11-25T19:39:46.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91632024-11-25T19:39:46.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
91642024-11-25T19:39:46.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91652024-11-25T19:39:46.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91662024-11-25T19:39:46.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
91672024-11-25T19:39:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
91682024-11-25T19:39:46.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91692024-11-25T19:39:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
91702024-11-25T19:39:46.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91712024-11-25T19:39:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91722024-11-25T19:39:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91732024-11-25T19:39:46.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91742024-11-25T19:39:46.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91752024-11-25T19:39:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91762024-11-25T19:39:46.858ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91772024-11-25T19:39:46.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91782024-11-25T19:39:46.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
91792024-11-25T19:39:46.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91802024-11-25T19:39:46.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91812024-11-25T19:39:46.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91822024-11-25T19:39:46.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91832024-11-25T19:39:46.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91842024-11-25T19:39:46.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91852024-11-25T19:39:46.865ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91862024-11-25T19:39:46.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91872024-11-25T19:39:46.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91882024-11-25T19:39:46.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91892024-11-25T19:39:46.866ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1612, tv_nsec: 410834637 } })
91902024-11-25T19:39:46.866ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
91912024-11-25T19:39:46.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91922024-11-25T19:39:46.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91932024-11-25T19:39:46.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91942024-11-25T19:39:46.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91952024-11-25T19:39:46.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91962024-11-25T19:39:46.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91972024-11-25T19:39:46.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91982024-11-25T19:39:46.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91992024-11-25T19:39:46.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92002024-11-25T19:39:46.875ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92012024-11-25T19:39:46.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92022024-11-25T19:39:46.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 33.705021ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
92032024-11-25T19:39:46.894ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92042024-11-25T19:39:46.894ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
92052024-11-25T19:39:46.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92062024-11-25T19:39:46.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92072024-11-25T19:39:46.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 45.33481ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
92082024-11-25T19:39:46.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92092024-11-25T19:39:46.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92102024-11-25T19:39:46.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92112024-11-25T19:39:46.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92122024-11-25T19:39:46.898ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92132024-11-25T19:39:46.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92142024-11-25T19:39:46.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 48.579693ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92152024-11-25T19:39:46.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92162024-11-25T19:39:46.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.766776ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
92172024-11-25T19:39:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
92182024-11-25T19:39:46.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92192024-11-25T19:39:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92202024-11-25T19:39:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92212024-11-25T19:39:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92222024-11-25T19:39:46.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92232024-11-25T19:39:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92242024-11-25T19:39:46.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92252024-11-25T19:39:46.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92262024-11-25T19:39:46.908ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
92272024-11-25T19:39:46.908ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.633801ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
92282024-11-25T19:39:46.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
92292024-11-25T19:39:46.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92302024-11-25T19:39:46.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92312024-11-25T19:39:46.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
92322024-11-25T19:39:46.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92332024-11-25T19:39:46.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92342024-11-25T19:39:46.915ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 64.710159ms iteration = 18 status = 0
92352024-11-25T19:39:46.923ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
92362024-11-25T19:39:46.923ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92372024-11-25T19:39:46.924ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fac2b4b-6d04-4a21-bc4b-bcdbf596f363", "content-length": "26", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
92382024-11-25T19:39:46.924ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92392024-11-25T19:39:46.924ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
92402024-11-25T19:39:46.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.104574ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
92412024-11-25T19:39:46.925ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92422024-11-25T19:39:46.925ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92432024-11-25T19:39:46.925ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
92442024-11-25T19:39:46.925ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92452024-11-25T19:39:46.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92462024-11-25T19:39:46.928ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.149903ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
92472024-11-25T19:39:46.928ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
92482024-11-25T19:39:46.928ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92492024-11-25T19:39:46.929ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "481f9e54-ce9a-46eb-8db4-2f5a814138ab", "content-length": "26", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
92502024-11-25T19:39:46.929ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92512024-11-25T19:39:46.931ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92522024-11-25T19:39:46.931ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92532024-11-25T19:39:46.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92542024-11-25T19:39:46.958ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92552024-11-25T19:39:46.958ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
92562024-11-25T19:39:46.958ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.949127ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
92572024-11-25T19:39:46.960ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
92582024-11-25T19:39:46.960ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92592024-11-25T19:39:46.960ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b476fdb-da25-4d15-b59a-cd6a7ae371a5", "content-length": "26", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
92602024-11-25T19:39:46.960ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92612024-11-25T19:39:46.962ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
92622024-11-25T19:39:46.966ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 115.990696ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
92632024-11-25T19:39:46.978ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 127.758687ms iteration = 20 status = {"physical_disks_added":0}
92642024-11-25T19:39:46.979ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92652024-11-25T19:39:46.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92662024-11-25T19:39:47.018ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
92672024-11-25T19:39:47.018ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "782095c8-7960-42d4-bd25-82ecbc74adf2", "content-length": "1", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
92682024-11-25T19:39:47.019ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 169.324622ms iteration = 18 status = {}
92692024-11-25T19:39:47.020ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92702024-11-25T19:39:47.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92712024-11-25T19:39:47.035ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
92722024-11-25T19:39:47.035ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92732024-11-25T19:39:47.036ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1b696f2-a8b9-462b-84ae-e4e18c474350", "content-length": "372", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
92742024-11-25T19:39:47.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92752024-11-25T19:39:47.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92762024-11-25T19:39:47.037ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92772024-11-25T19:39:47.038ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 188.273613ms iteration = 18 status = null
92782024-11-25T19:39:47.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92792024-11-25T19:39:47.039ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92802024-11-25T19:39:47.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92812024-11-25T19:39:47.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92822024-11-25T19:39:47.042ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92832024-11-25T19:39:47.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92842024-11-25T19:39:47.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92852024-11-25T19:39:47.050ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
92862024-11-25T19:39:47.050ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
92872024-11-25T19:39:47.051ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2180261b-5083-4892-8e2f-eead07f87d2d", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
92882024-11-25T19:39:47.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92892024-11-25T19:39:47.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92902024-11-25T19:39:47.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92912024-11-25T19:39:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92922024-11-25T19:39:47.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92932024-11-25T19:39:47.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92942024-11-25T19:39:47.063ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
92952024-11-25T19:39:47.063ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92962024-11-25T19:39:47.063ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f480b0c8-05d0-447b-8234-1c6e92391612", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
92972024-11-25T19:39:47.066ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 215.808614ms iteration = 18 status = {}
92982024-11-25T19:39:47.115ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
92992024-11-25T19:39:47.115ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "079c753a-4534-4995-a67d-b8e0c2d72772", "content-length": "691", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
93002024-11-25T19:39:47.115ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
93012024-11-25T19:39:47.115ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
93022024-11-25T19:39:47.115ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
93032024-11-25T19:39:47.118ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 267.818034ms iteration = 18 status = {}
93042024-11-25T19:39:47.152ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93052024-11-25T19:39:47.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93062024-11-25T19:39:47.154ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
93072024-11-25T19:39:47.154ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93082024-11-25T19:39:47.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93092024-11-25T19:39:47.162ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
93102024-11-25T19:39:47.162ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "38e7d74a-f9d8-4802-a54c-f50758e5c7d1", "content-length": "134", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
93112024-11-25T19:39:47.162ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
93122024-11-25T19:39:47.162ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
93132024-11-25T19:39:47.163ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
93142024-11-25T19:39:47.163ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
93152024-11-25T19:39:47.163ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93162024-11-25T19:39:47.163ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93172024-11-25T19:39:47.163ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93182024-11-25T19:39:47.163ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93192024-11-25T19:39:47.163ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93202024-11-25T19:39:47.163ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93212024-11-25T19:39:47.163ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
93222024-11-25T19:39:47.163ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93232024-11-25T19:39:47.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93242024-11-25T19:39:47.166ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
93252024-11-25T19:39:47.166ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbc39624-f1a3-4b75-bb30-18cfa80b9337", "content-length": "2", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
93262024-11-25T19:39:47.166ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
93272024-11-25T19:39:47.166ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "df0a7f4b-9264-4b23-a0e9-3b660e91b4a1", "content-length": "51", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
93282024-11-25T19:39:47.166ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
93292024-11-25T19:39:47.166ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
93302024-11-25T19:39:47.258ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6c1fd526-82aa-4340-a537-838451dddfc3", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
93312024-11-25T19:39:47.258ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
93322024-11-25T19:39:47.258ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
93332024-11-25T19:39:47.258ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5104821-d9ee-430d-8b4f-e59a944a7674", "content-length": "682", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
93342024-11-25T19:39:47.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93352024-11-25T19:39:47.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93362024-11-25T19:39:47.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93372024-11-25T19:39:47.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93382024-11-25T19:39:47.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93392024-11-25T19:39:47.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93402024-11-25T19:39:47.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93412024-11-25T19:39:47.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93422024-11-25T19:39:47.275ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 425.642391ms iteration = 18 status = {}
93432024-11-25T19:39:47.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 81ce276c-9d24-4d37-9583-f035407004ed roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93442024-11-25T19:39:47.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 81ce276c-9d24-4d37-9583-f035407004ed resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93452024-11-25T19:39:47.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 81ce276c-9d24-4d37-9583-f035407004ed response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93462024-11-25T19:39:47.476ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
93472024-11-25T19:39:47.476ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
93482024-11-25T19:39:47.507ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
93492024-11-25T19:39:47.507ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:59348
93502024-11-25T19:39:47.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59348 req_id = e2f9df0c-b7fe-4b9c-95e2-33ad2f023e38 roles = RoleSet { roles: {} } uri = /metrics/producers
93512024-11-25T19:39:47.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59348 req_id = e2f9df0c-b7fe-4b9c-95e2-33ad2f023e38 resource = Database result = Ok(()) uri = /metrics/producers
93522024-11-25T19:39:47.544ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
93532024-11-25T19:39:47.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36645 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59348 req_id = e2f9df0c-b7fe-4b9c-95e2-33ad2f023e38 response_code = 201 uri = /metrics/producers
93542024-11-25T19:39:47.544ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "e2f9df0c-b7fe-4b9c-95e2-33ad2f023e38", "content-length": "41", "date": "Mon, 25 Nov 2024 19:39:47 GMT"} })
93552024-11-25T19:39:47.546ZDEBGnexus (producer-registration-task): registered with nexus successfully
93562024-11-25T19:39:47.546ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
93572024-11-25T19:39:48.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b9531751-4dcb-4d16-933d-502c0193cf74 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93582024-11-25T19:39:48.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b9531751-4dcb-4d16-933d-502c0193cf74 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93592024-11-25T19:39:48.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b9531751-4dcb-4d16-933d-502c0193cf74 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93602024-11-25T19:39:49.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0db8738c-0ca1-462b-9036-2ecd3234180d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93612024-11-25T19:39:49.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0db8738c-0ca1-462b-9036-2ecd3234180d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93622024-11-25T19:39:49.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1826 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0db8738c-0ca1-462b-9036-2ecd3234180d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93632024-11-25T19:39:50.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cf5d93f1-9c85-4465-919e-0929a1f59852 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93642024-11-25T19:39:50.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cf5d93f1-9c85-4465-919e-0929a1f59852 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93652024-11-25T19:39:50.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cf5d93f1-9c85-4465-919e-0929a1f59852 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93662024-11-25T19:39:51.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90acfbc0-7436-4daa-9f2a-b09e8e735990 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93672024-11-25T19:39:51.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90acfbc0-7436-4daa-9f2a-b09e8e735990 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93682024-11-25T19:39:51.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90acfbc0-7436-4daa-9f2a-b09e8e735990 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93692024-11-25T19:39:52.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 481 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 2acf9fa5-177f-4818-bdd7-111d3ea6934a response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
93702024-11-25T19:39:52.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e424eaef-e9c7-46e0-b90a-cdbb8ad12b80 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93712024-11-25T19:39:52.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e424eaef-e9c7-46e0-b90a-cdbb8ad12b80 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93722024-11-25T19:39:52.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e424eaef-e9c7-46e0-b90a-cdbb8ad12b80 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93732024-11-25T19:39:53.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2a66608f-4135-4652-a30f-12b29e2b6afa roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93742024-11-25T19:39:53.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2a66608f-4135-4652-a30f-12b29e2b6afa resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93752024-11-25T19:39:53.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2a66608f-4135-4652-a30f-12b29e2b6afa response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93762024-11-25T19:39:54.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 461d5e0b-a7da-416a-b6f4-e75f46ffbd12 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93772024-11-25T19:39:54.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 461d5e0b-a7da-416a-b6f4-e75f46ffbd12 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93782024-11-25T19:39:54.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 461d5e0b-a7da-416a-b6f4-e75f46ffbd12 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93792024-11-25T19:39:55.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = df5bef18-6710-4076-a562-35c926187d49 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93802024-11-25T19:39:55.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = df5bef18-6710-4076-a562-35c926187d49 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93812024-11-25T19:39:55.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = df5bef18-6710-4076-a562-35c926187d49 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93822024-11-25T19:39:56.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 28f8b13e-ee5b-4db5-92c1-5f7e288adb4b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93832024-11-25T19:39:56.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 28f8b13e-ee5b-4db5-92c1-5f7e288adb4b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93842024-11-25T19:39:56.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 28f8b13e-ee5b-4db5-92c1-5f7e288adb4b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
93852024-11-25T19:39:56.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
93862024-11-25T19:39:56.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93872024-11-25T19:39:56.850ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
93882024-11-25T19:39:56.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93892024-11-25T19:39:56.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93902024-11-25T19:39:56.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93912024-11-25T19:39:56.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93922024-11-25T19:39:56.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93932024-11-25T19:39:56.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93942024-11-25T19:39:56.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93952024-11-25T19:39:56.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93962024-11-25T19:39:56.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93972024-11-25T19:39:56.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93982024-11-25T19:39:56.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
93992024-11-25T19:39:56.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94002024-11-25T19:39:56.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94012024-11-25T19:39:56.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
94022024-11-25T19:39:56.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.989862ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
94032024-11-25T19:39:56.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94042024-11-25T19:39:56.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94052024-11-25T19:39:56.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.0778ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94062024-11-25T19:39:57.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 27454133-b879-4eca-b89c-6365d9f64aeb roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94072024-11-25T19:39:57.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 27454133-b879-4eca-b89c-6365d9f64aeb resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94082024-11-25T19:39:57.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 27454133-b879-4eca-b89c-6365d9f64aeb response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94092024-11-25T19:39:58.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fe9ccea9-5996-4292-ab43-4bb2234d5ab8 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94102024-11-25T19:39:58.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fe9ccea9-5996-4292-ab43-4bb2234d5ab8 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94112024-11-25T19:39:58.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fe9ccea9-5996-4292-ab43-4bb2234d5ab8 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94122024-11-25T19:39:59.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 20dd20cb-bb86-4166-b6be-b83a60c13c4d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94132024-11-25T19:39:59.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 20dd20cb-bb86-4166-b6be-b83a60c13c4d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94142024-11-25T19:39:59.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 20dd20cb-bb86-4166-b6be-b83a60c13c4d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94152024-11-25T19:40:00.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e3dc9fe4-ab5a-4c5e-ad3d-d0707fe7fd55 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94162024-11-25T19:40:00.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e3dc9fe4-ab5a-4c5e-ad3d-d0707fe7fd55 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94172024-11-25T19:40:00.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e3dc9fe4-ab5a-4c5e-ad3d-d0707fe7fd55 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94182024-11-25T19:40:01.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bcd5d3ca-3f01-4962-a284-b9635f472b29 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94192024-11-25T19:40:01.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bcd5d3ca-3f01-4962-a284-b9635f472b29 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94202024-11-25T19:40:01.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2809 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bcd5d3ca-3f01-4962-a284-b9635f472b29 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94212024-11-25T19:40:02.287ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 850 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 8742286d-f16d-48d4-b153-6a3f0fce05a5 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
94222024-11-25T19:40:02.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2c1591e9-1060-466b-abee-dca36218acbf roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94232024-11-25T19:40:02.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2c1591e9-1060-466b-abee-dca36218acbf resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94242024-11-25T19:40:02.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2c1591e9-1060-466b-abee-dca36218acbf response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94252024-11-25T19:40:03.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 66fdc8f0-0a3e-4597-ac79-73d7416c7ade roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94262024-11-25T19:40:03.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 66fdc8f0-0a3e-4597-ac79-73d7416c7ade resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94272024-11-25T19:40:03.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 66fdc8f0-0a3e-4597-ac79-73d7416c7ade response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94282024-11-25T19:40:04.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e94f8898-fb13-48f9-8820-1f338de5606a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94292024-11-25T19:40:04.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e94f8898-fb13-48f9-8820-1f338de5606a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94302024-11-25T19:40:04.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e94f8898-fb13-48f9-8820-1f338de5606a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94312024-11-25T19:40:05.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 95fc030e-4956-4040-b6a6-0474faa51b57 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94322024-11-25T19:40:05.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 95fc030e-4956-4040-b6a6-0474faa51b57 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94332024-11-25T19:40:05.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 95fc030e-4956-4040-b6a6-0474faa51b57 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94342024-11-25T19:40:06.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90190b3b-ca1f-406a-9f7d-1d1dece85072 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94352024-11-25T19:40:06.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90190b3b-ca1f-406a-9f7d-1d1dece85072 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94362024-11-25T19:40:06.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90190b3b-ca1f-406a-9f7d-1d1dece85072 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94372024-11-25T19:40:06.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
94382024-11-25T19:40:06.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94392024-11-25T19:40:06.850ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
94402024-11-25T19:40:06.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94412024-11-25T19:40:06.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94422024-11-25T19:40:06.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94432024-11-25T19:40:06.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94442024-11-25T19:40:06.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94452024-11-25T19:40:06.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94462024-11-25T19:40:06.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.691862ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94472024-11-25T19:40:06.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94482024-11-25T19:40:06.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94492024-11-25T19:40:06.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94502024-11-25T19:40:06.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94512024-11-25T19:40:06.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94522024-11-25T19:40:06.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94532024-11-25T19:40:06.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
94542024-11-25T19:40:06.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94552024-11-25T19:40:06.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94562024-11-25T19:40:06.874ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
94572024-11-25T19:40:06.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.724676ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
94582024-11-25T19:40:07.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6af3b088-46ae-4d5b-ab0c-58c971ff9bd6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94592024-11-25T19:40:07.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6af3b088-46ae-4d5b-ab0c-58c971ff9bd6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94602024-11-25T19:40:07.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6af3b088-46ae-4d5b-ab0c-58c971ff9bd6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94612024-11-25T19:40:08.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e4b87da3-d01e-460e-b6d1-8b2acb5697af roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94622024-11-25T19:40:08.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e4b87da3-d01e-460e-b6d1-8b2acb5697af resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94632024-11-25T19:40:08.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e4b87da3-d01e-460e-b6d1-8b2acb5697af response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94642024-11-25T19:40:09.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3e199e8c-fc64-4024-b511-e1eb2012937f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94652024-11-25T19:40:09.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3e199e8c-fc64-4024-b511-e1eb2012937f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94662024-11-25T19:40:09.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3e199e8c-fc64-4024-b511-e1eb2012937f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94672024-11-25T19:40:10.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = efede7ae-dd44-4c91-90a9-09b5e8698d55 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94682024-11-25T19:40:10.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = efede7ae-dd44-4c91-90a9-09b5e8698d55 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94692024-11-25T19:40:10.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = efede7ae-dd44-4c91-90a9-09b5e8698d55 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94702024-11-25T19:40:11.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 452a2b22-bab2-4473-922f-35fb915641de roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94712024-11-25T19:40:11.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 452a2b22-bab2-4473-922f-35fb915641de resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94722024-11-25T19:40:11.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 452a2b22-bab2-4473-922f-35fb915641de response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94732024-11-25T19:40:12.287ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 584 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = b8ad5b3c-207e-4b83-85da-63af192da6c8 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
94742024-11-25T19:40:12.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aa8d2454-5958-4bce-984f-eee0bfe588ad roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94752024-11-25T19:40:12.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aa8d2454-5958-4bce-984f-eee0bfe588ad resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94762024-11-25T19:40:12.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aa8d2454-5958-4bce-984f-eee0bfe588ad response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94772024-11-25T19:40:13.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f8a86e7b-1507-4525-b8f3-dd55411b60a0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94782024-11-25T19:40:13.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f8a86e7b-1507-4525-b8f3-dd55411b60a0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94792024-11-25T19:40:13.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f8a86e7b-1507-4525-b8f3-dd55411b60a0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94802024-11-25T19:40:14.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4061fbdd-71cc-45cf-8d26-deb760a2d8e0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94812024-11-25T19:40:14.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4061fbdd-71cc-45cf-8d26-deb760a2d8e0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94822024-11-25T19:40:14.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4061fbdd-71cc-45cf-8d26-deb760a2d8e0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94832024-11-25T19:40:15.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ef408b4c-1930-45e0-beaf-26106d7e912a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94842024-11-25T19:40:15.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ef408b4c-1930-45e0-beaf-26106d7e912a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94852024-11-25T19:40:15.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ef408b4c-1930-45e0-beaf-26106d7e912a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
94862024-11-25T19:40:16.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 0a117656-3cee-4941-a2a7-99df541ad0b9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
94872024-11-25T19:40:16.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 0a117656-3cee-4941-a2a7-99df541ad0b9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
94882024-11-25T19:40:16.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 0a117656-3cee-4941-a2a7-99df541ad0b9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
94892024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
94902024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
94912024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
94922024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
94932024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94942024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
94952024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
94962024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94972024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
94982024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
94992024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
95002024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95012024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
95022024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
95032024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
95042024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
95052024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95062024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
95072024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95082024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
95092024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
95102024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
95112024-11-25T19:40:16.850ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
95122024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.77\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
95132024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
95142024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
95152024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
95162024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
95172024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95182024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
95192024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
95202024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
95212024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95222024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
95232024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
95242024-11-25T19:40:16.850ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
95252024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
95262024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
95272024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
95282024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95292024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
95302024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
95312024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95322024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
95332024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
95342024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
95352024-11-25T19:40:16.850ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
95362024-11-25T19:40:16.850ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
95372024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95382024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
95392024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
95402024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
95412024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
95422024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
95432024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
95442024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95452024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
95462024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
95472024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95482024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
95492024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
95502024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
95512024-11-25T19:40:16.851ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:30:16.850992825 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
95522024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
95532024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
95542024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
95552024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95562024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95572024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
95582024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95592024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95602024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
95612024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95622024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
95632024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
95642024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
95652024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95662024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
95672024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95682024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95692024-11-25T19:40:16.851ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1642, tv_nsec: 395771281 } })
95702024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
95712024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
95722024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95732024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
95742024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95752024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
95762024-11-25T19:40:16.851ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1642, tv_nsec: 395831372 } })
95772024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
95782024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
95792024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
95802024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
95812024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
95822024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
95832024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
95842024-11-25T19:40:16.851ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.01125ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
95852024-11-25T19:40:16.852ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
95862024-11-25T19:40:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.390677ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
95872024-11-25T19:40:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
95882024-11-25T19:40:16.852ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
95892024-11-25T19:40:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
95902024-11-25T19:40:16.852ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
95912024-11-25T19:40:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
95922024-11-25T19:40:16.853ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1642, tv_nsec: 398040776 } })
95932024-11-25T19:40:16.853ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
95942024-11-25T19:40:16.854ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.708743ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
95952024-11-25T19:40:16.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95962024-11-25T19:40:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95972024-11-25T19:40:16.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95982024-11-25T19:40:16.856ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1642, tv_nsec: 400485034 } })
95992024-11-25T19:40:16.856ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
96002024-11-25T19:40:16.857ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96012024-11-25T19:40:16.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96022024-11-25T19:40:16.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
96032024-11-25T19:40:16.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96042024-11-25T19:40:16.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96052024-11-25T19:40:16.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96062024-11-25T19:40:16.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96072024-11-25T19:40:16.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96082024-11-25T19:40:16.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
96092024-11-25T19:40:16.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96102024-11-25T19:40:16.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96112024-11-25T19:40:16.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
96122024-11-25T19:40:16.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96132024-11-25T19:40:16.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96142024-11-25T19:40:16.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96152024-11-25T19:40:16.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96162024-11-25T19:40:16.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96172024-11-25T19:40:16.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96182024-11-25T19:40:16.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96192024-11-25T19:40:16.866ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.530315ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
96202024-11-25T19:40:16.867ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96212024-11-25T19:40:16.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
96222024-11-25T19:40:16.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96232024-11-25T19:40:16.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96242024-11-25T19:40:16.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96252024-11-25T19:40:16.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
96262024-11-25T19:40:16.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96272024-11-25T19:40:16.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96282024-11-25T19:40:16.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96292024-11-25T19:40:16.869ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96302024-11-25T19:40:16.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96312024-11-25T19:40:16.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96322024-11-25T19:40:16.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96332024-11-25T19:40:16.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
96342024-11-25T19:40:16.870ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96352024-11-25T19:40:16.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96362024-11-25T19:40:16.871ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:30:16.850992825 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
96372024-11-25T19:40:16.871ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 20.786168ms iteration = 10 status = {"expiration":"2024-11-25T19:30:16.850992825Z","pruned":[]}
96382024-11-25T19:40:16.872ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96392024-11-25T19:40:16.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96402024-11-25T19:40:16.872ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96412024-11-25T19:40:16.874ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 23.875368ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96422024-11-25T19:40:16.874ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 24.224716ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
96432024-11-25T19:40:16.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
96442024-11-25T19:40:16.874ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96452024-11-25T19:40:16.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96462024-11-25T19:40:16.875ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96472024-11-25T19:40:16.876ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96482024-11-25T19:40:16.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96492024-11-25T19:40:16.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
96502024-11-25T19:40:16.877ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96512024-11-25T19:40:16.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96522024-11-25T19:40:16.877ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96532024-11-25T19:40:16.877ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1642, tv_nsec: 421720760 } })
96542024-11-25T19:40:16.877ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
96552024-11-25T19:40:16.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
96562024-11-25T19:40:16.879ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96572024-11-25T19:40:16.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96582024-11-25T19:40:16.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96592024-11-25T19:40:16.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96602024-11-25T19:40:16.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96612024-11-25T19:40:16.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96622024-11-25T19:40:16.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96632024-11-25T19:40:16.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96642024-11-25T19:40:16.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96652024-11-25T19:40:16.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
96662024-11-25T19:40:16.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96672024-11-25T19:40:16.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96682024-11-25T19:40:16.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
96692024-11-25T19:40:16.886ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
96702024-11-25T19:40:16.886ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
96712024-11-25T19:40:16.886ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
96722024-11-25T19:40:16.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96732024-11-25T19:40:16.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96742024-11-25T19:40:16.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
96752024-11-25T19:40:16.888ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96762024-11-25T19:40:16.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
96772024-11-25T19:40:16.890ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96782024-11-25T19:40:16.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96792024-11-25T19:40:16.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96802024-11-25T19:40:16.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96812024-11-25T19:40:16.894ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96822024-11-25T19:40:16.894ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
96832024-11-25T19:40:16.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96842024-11-25T19:40:16.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96852024-11-25T19:40:16.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96862024-11-25T19:40:16.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96872024-11-25T19:40:16.896ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
96882024-11-25T19:40:16.896ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
96892024-11-25T19:40:16.896ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 45.992642ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
96902024-11-25T19:40:16.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
96912024-11-25T19:40:16.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96922024-11-25T19:40:16.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96932024-11-25T19:40:16.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
96942024-11-25T19:40:16.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96952024-11-25T19:40:16.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96962024-11-25T19:40:16.901ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96972024-11-25T19:40:16.901ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
96982024-11-25T19:40:16.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96992024-11-25T19:40:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97002024-11-25T19:40:16.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.059242ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
97012024-11-25T19:40:16.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3d314bb8-0ded-4307-8ee8-d2e81b9caf9b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
97022024-11-25T19:40:16.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3d314bb8-0ded-4307-8ee8-d2e81b9caf9b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
97032024-11-25T19:40:16.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3d314bb8-0ded-4307-8ee8-d2e81b9caf9b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
97042024-11-25T19:40:16.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.763453ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
97052024-11-25T19:40:16.915ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
97062024-11-25T19:40:16.915ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.798252ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
97072024-11-25T19:40:16.917ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97082024-11-25T19:40:16.917ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97092024-11-25T19:40:16.920ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
97102024-11-25T19:40:16.920ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97112024-11-25T19:40:16.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97122024-11-25T19:40:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97132024-11-25T19:40:16.921ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97142024-11-25T19:40:16.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97152024-11-25T19:40:16.922ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97162024-11-25T19:40:16.924ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97172024-11-25T19:40:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97182024-11-25T19:40:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97192024-11-25T19:40:16.924ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97202024-11-25T19:40:16.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97212024-11-25T19:40:16.926ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 75.624763ms iteration = 5 status = {"nsuccess":5}
97222024-11-25T19:40:16.933ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
97232024-11-25T19:40:16.933ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
97242024-11-25T19:40:16.933ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 82.57887ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
97252024-11-25T19:40:16.935ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
97262024-11-25T19:40:16.935ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.387625ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
97272024-11-25T19:40:16.935ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97282024-11-25T19:40:16.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97292024-11-25T19:40:16.937ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97302024-11-25T19:40:16.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97312024-11-25T19:40:16.940ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 89.957224ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
97322024-11-25T19:40:16.941ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97332024-11-25T19:40:16.941ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
97342024-11-25T19:40:16.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97352024-11-25T19:40:16.941ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
97362024-11-25T19:40:16.941ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
97372024-11-25T19:40:16.941ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
97382024-11-25T19:40:16.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97392024-11-25T19:40:16.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
97402024-11-25T19:40:16.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97412024-11-25T19:40:16.943ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97422024-11-25T19:40:16.944ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97432024-11-25T19:40:16.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
97442024-11-25T19:40:16.947ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97452024-11-25T19:40:16.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97462024-11-25T19:40:16.947ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
97472024-11-25T19:40:16.947ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
97482024-11-25T19:40:16.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97492024-11-25T19:40:16.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97502024-11-25T19:40:16.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97512024-11-25T19:40:16.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97522024-11-25T19:40:16.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97532024-11-25T19:40:16.948ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.586954ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97542024-11-25T19:40:16.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97552024-11-25T19:40:16.949ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.426091ms iteration = 19 status = 0
97562024-11-25T19:40:16.951ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 100.759907ms iteration = 21 status = {"physical_disks_added":0}
97572024-11-25T19:40:16.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97582024-11-25T19:40:16.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97592024-11-25T19:40:16.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97602024-11-25T19:40:16.954ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97612024-11-25T19:40:16.954ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
97622024-11-25T19:40:16.954ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.125763ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
97632024-11-25T19:40:16.955ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
97642024-11-25T19:40:16.955ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
97652024-11-25T19:40:16.955ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
97662024-11-25T19:40:16.955ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 104.779075ms iteration = 10 status = {"generation":1}
97672024-11-25T19:40:16.967ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97682024-11-25T19:40:16.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
97692024-11-25T19:40:16.970ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97702024-11-25T19:40:16.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97712024-11-25T19:40:16.978ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
97722024-11-25T19:40:16.978ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
97732024-11-25T19:40:16.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97742024-11-25T19:40:16.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97752024-11-25T19:40:16.979ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97762024-11-25T19:40:16.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97772024-11-25T19:40:16.983ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97782024-11-25T19:40:16.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97792024-11-25T19:40:16.985ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
97802024-11-25T19:40:16.985ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
97812024-11-25T19:40:16.985ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
97822024-11-25T19:40:16.985ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 134.267354ms iteration = 10 status = {"generation":2}
97832024-11-25T19:40:16.997ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
97842024-11-25T19:40:16.997ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 146.314161ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
97852024-11-25T19:40:16.998ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97862024-11-25T19:40:16.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97872024-11-25T19:40:16.998ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97882024-11-25T19:40:16.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97892024-11-25T19:40:16.999ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97902024-11-25T19:40:17.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97912024-11-25T19:40:17.001ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
97922024-11-25T19:40:17.001ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97932024-11-25T19:40:17.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97942024-11-25T19:40:17.002ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97952024-11-25T19:40:17.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97962024-11-25T19:40:17.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97972024-11-25T19:40:17.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97982024-11-25T19:40:17.005ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97992024-11-25T19:40:17.005ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98002024-11-25T19:40:17.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98012024-11-25T19:40:17.009ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98022024-11-25T19:40:17.009ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98032024-11-25T19:40:17.009ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c6e0bc2-8665-4cbc-9edf-0e997c992692", "content-length": "26", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
98042024-11-25T19:40:17.009ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98052024-11-25T19:40:17.011ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98062024-11-25T19:40:17.037ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
98072024-11-25T19:40:17.038ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 187.03417ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
98082024-11-25T19:40:17.040ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98092024-11-25T19:40:17.040ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98102024-11-25T19:40:17.040ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba3d7c63-fe3b-4eeb-b6b5-59e245219f1d", "content-length": "26", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
98112024-11-25T19:40:17.040ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98122024-11-25T19:40:17.042ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98132024-11-25T19:40:17.062ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
98142024-11-25T19:40:17.062ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98152024-11-25T19:40:17.062ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e7e7977-e4ae-49fc-b155-b12dbb16cd84", "content-length": "372", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
98162024-11-25T19:40:17.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98172024-11-25T19:40:17.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98182024-11-25T19:40:17.085ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
98192024-11-25T19:40:17.085ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98202024-11-25T19:40:17.086ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9767e18c-9888-40eb-b712-031289feced8", "content-length": "26", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
98212024-11-25T19:40:17.086ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98222024-11-25T19:40:17.088ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
98232024-11-25T19:40:17.129ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
98242024-11-25T19:40:17.129ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
98252024-11-25T19:40:17.129ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9b85f1c2-0b70-4e28-ac8e-5ae11ef18cc6", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
98262024-11-25T19:40:17.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98272024-11-25T19:40:17.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98282024-11-25T19:40:17.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98292024-11-25T19:40:17.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98302024-11-25T19:40:17.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98312024-11-25T19:40:17.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98322024-11-25T19:40:17.178ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
98332024-11-25T19:40:17.197ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
98342024-11-25T19:40:17.198ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "69407ba6-c0f1-4e3f-9f25-e24d34412553", "content-length": "1", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
98352024-11-25T19:40:17.199ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
98362024-11-25T19:40:17.200ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98372024-11-25T19:40:17.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98382024-11-25T19:40:17.237ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 387.151026ms iteration = 19 status = {}
98392024-11-25T19:40:17.333ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
98402024-11-25T19:40:17.334ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5deb541d-68d0-4e64-b7ac-a059803701b9", "content-length": "691", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
98412024-11-25T19:40:17.334ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
98422024-11-25T19:40:17.334ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
98432024-11-25T19:40:17.334ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
98442024-11-25T19:40:17.335ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 484.970735ms iteration = 19 status = {}
98452024-11-25T19:40:17.337ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
98462024-11-25T19:40:17.337ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98472024-11-25T19:40:17.338ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bc6baf5c-3588-4d26-8308-23fdcc0c9d7b", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
98482024-11-25T19:40:17.339ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 488.930663ms iteration = 19 status = null
98492024-11-25T19:40:17.339ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 489.042915ms iteration = 19 status = {}
98502024-11-25T19:40:17.423ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
98512024-11-25T19:40:17.428ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
98522024-11-25T19:40:17.428ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "653190f9-4a64-47c0-b91d-493862c3efcf", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98532024-11-25T19:40:17.428ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98542024-11-25T19:40:17.430ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6a5e3bff-8d42-4ec4-806c-b57fa1ae6cd3", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98552024-11-25T19:40:17.430ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98562024-11-25T19:40:17.432ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98572024-11-25T19:40:17.432ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 581.364066ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
98582024-11-25T19:40:17.465ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
98592024-11-25T19:40:17.466ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f81d6095-8979-49d0-834d-d672b9eccc5d", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
98602024-11-25T19:40:17.466ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
98612024-11-25T19:40:17.468ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ca32c108-6212-4d92-a86d-d7f1b0082933", "date": "Mon, 25 Nov 2024 19:40:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
98622024-11-25T19:40:17.468ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
98632024-11-25T19:40:17.469ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98642024-11-25T19:40:17.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98652024-11-25T19:40:17.470ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "44860b07-059f-42b1-b5dd-89aedf2e54dd", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
98662024-11-25T19:40:17.470ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
98672024-11-25T19:40:17.472ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
98682024-11-25T19:40:17.472ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 621.385892ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
98692024-11-25T19:40:17.472ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
98702024-11-25T19:40:17.472ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98712024-11-25T19:40:17.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98722024-11-25T19:40:17.482ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
98732024-11-25T19:40:17.482ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "552c7030-47cf-4885-8c5b-208c53532794", "content-length": "134", "date": "Mon, 25 Nov 2024 19:40:17 GMT"} })
98742024-11-25T19:40:17.482ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
98752024-11-25T19:40:17.482ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
98762024-11-25T19:40:17.484ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
98772024-11-25T19:40:17.484ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
98782024-11-25T19:40:17.484ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98792024-11-25T19:40:17.484ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98802024-11-25T19:40:17.484ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98812024-11-25T19:40:17.484ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98822024-11-25T19:40:17.484ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98832024-11-25T19:40:17.484ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98842024-11-25T19:40:17.484ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
98852024-11-25T19:40:17.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98862024-11-25T19:40:17.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98872024-11-25T19:40:17.486ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
98882024-11-25T19:40:17.486ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d58ae559-8ae5-4c18-8771-afe4aa3ee5c4", "content-length": "2", "date": "Mon, 25 Nov 2024 19:40:17 GMT"} })
98892024-11-25T19:40:17.486ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
98902024-11-25T19:40:17.486ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "42961fe5-a573-4b0c-a824-de3033b9b200", "content-length": "51", "date": "Mon, 25 Nov 2024 19:40:17 GMT"} })
98912024-11-25T19:40:17.486ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
98922024-11-25T19:40:17.486ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
98932024-11-25T19:40:17.583ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bb05ecf6-fdd9-43d2-8411-ed9c28cd9cad", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
98942024-11-25T19:40:17.583ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
98952024-11-25T19:40:17.583ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
98962024-11-25T19:40:17.583ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6ae8e27-19be-4e7c-a581-460034c04575", "content-length": "682", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
98972024-11-25T19:40:17.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98982024-11-25T19:40:17.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98992024-11-25T19:40:17.587ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99002024-11-25T19:40:17.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99012024-11-25T19:40:17.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99022024-11-25T19:40:17.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99032024-11-25T19:40:17.593ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99042024-11-25T19:40:17.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99052024-11-25T19:40:17.601ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 751.141407ms iteration = 19 status = {}
99062024-11-25T19:40:17.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ea7bf053-f2e8-4966-839c-39c458c35588 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99072024-11-25T19:40:17.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ea7bf053-f2e8-4966-839c-39c458c35588 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99082024-11-25T19:40:17.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1700 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ea7bf053-f2e8-4966-839c-39c458c35588 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99092024-11-25T19:40:18.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 50821aba-eba5-494c-b357-7aa40d8a900d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99102024-11-25T19:40:18.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 50821aba-eba5-494c-b357-7aa40d8a900d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99112024-11-25T19:40:18.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 50821aba-eba5-494c-b357-7aa40d8a900d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99122024-11-25T19:40:19.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4a122c88-3e70-4bcf-9b1a-a5be6bfbfeac roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99132024-11-25T19:40:19.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4a122c88-3e70-4bcf-9b1a-a5be6bfbfeac resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99142024-11-25T19:40:19.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4a122c88-3e70-4bcf-9b1a-a5be6bfbfeac response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99152024-11-25T19:40:20.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e94c97b7-64a5-4511-a450-4d34d8b767c2 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99162024-11-25T19:40:20.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e94c97b7-64a5-4511-a450-4d34d8b767c2 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99172024-11-25T19:40:20.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e94c97b7-64a5-4511-a450-4d34d8b767c2 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99182024-11-25T19:40:22.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 378a9219-00cf-4abd-a77c-49296b7cb020 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99192024-11-25T19:40:22.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 378a9219-00cf-4abd-a77c-49296b7cb020 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99202024-11-25T19:40:22.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 378a9219-00cf-4abd-a77c-49296b7cb020 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99212024-11-25T19:40:22.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = c0481c85-871b-4abf-8cbc-e1b7f6868d4b roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
99222024-11-25T19:40:22.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = c0481c85-871b-4abf-8cbc-e1b7f6868d4b resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
99232024-11-25T19:40:22.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = c0481c85-871b-4abf-8cbc-e1b7f6868d4b response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
99242024-11-25T19:40:22.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = d11908f4-d7da-4f2d-bd72-1c51acd56771 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
99252024-11-25T19:40:22.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = d11908f4-d7da-4f2d-bd72-1c51acd56771 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
99262024-11-25T19:40:22.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = d11908f4-d7da-4f2d-bd72-1c51acd56771 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
99272024-11-25T19:40:22.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 450 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = d04594b3-63b5-4b66-b285-b92290dd0381 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
99282024-11-25T19:40:23.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 71fcec7b-15fa-4f8c-b86d-a678fb140b0e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99292024-11-25T19:40:23.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 71fcec7b-15fa-4f8c-b86d-a678fb140b0e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99302024-11-25T19:40:23.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 71fcec7b-15fa-4f8c-b86d-a678fb140b0e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99312024-11-25T19:40:24.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3ad6290e-c216-4c63-ba85-4ea84730b4a1 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99322024-11-25T19:40:24.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3ad6290e-c216-4c63-ba85-4ea84730b4a1 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99332024-11-25T19:40:24.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3ad6290e-c216-4c63-ba85-4ea84730b4a1 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99342024-11-25T19:40:25.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ebbca68a-db2d-4f1b-9a4a-f93c68be8c72 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99352024-11-25T19:40:25.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ebbca68a-db2d-4f1b-9a4a-f93c68be8c72 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99362024-11-25T19:40:25.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ebbca68a-db2d-4f1b-9a4a-f93c68be8c72 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99372024-11-25T19:40:26.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = de38e22c-eec3-4046-8764-cc57e9f8fffe roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99382024-11-25T19:40:26.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = de38e22c-eec3-4046-8764-cc57e9f8fffe resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99392024-11-25T19:40:26.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = de38e22c-eec3-4046-8764-cc57e9f8fffe response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99402024-11-25T19:40:26.849ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
99412024-11-25T19:40:26.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
99422024-11-25T19:40:26.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99432024-11-25T19:40:26.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99442024-11-25T19:40:26.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99452024-11-25T19:40:26.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99462024-11-25T19:40:26.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99472024-11-25T19:40:26.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99482024-11-25T19:40:26.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99492024-11-25T19:40:26.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99502024-11-25T19:40:26.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99512024-11-25T19:40:26.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99522024-11-25T19:40:26.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99532024-11-25T19:40:26.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99542024-11-25T19:40:26.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99552024-11-25T19:40:26.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
99562024-11-25T19:40:26.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99572024-11-25T19:40:26.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99582024-11-25T19:40:26.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
99592024-11-25T19:40:26.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.944061ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
99602024-11-25T19:40:26.879ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.880846ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99612024-11-25T19:40:27.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b194470b-2ca7-4954-a77b-4afe39cad02a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99622024-11-25T19:40:27.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b194470b-2ca7-4954-a77b-4afe39cad02a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99632024-11-25T19:40:27.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b194470b-2ca7-4954-a77b-4afe39cad02a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99642024-11-25T19:40:28.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7216c9d5-4f19-4735-a003-4ea67be55633 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99652024-11-25T19:40:28.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7216c9d5-4f19-4735-a003-4ea67be55633 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99662024-11-25T19:40:28.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7216c9d5-4f19-4735-a003-4ea67be55633 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99672024-11-25T19:40:29.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f4caefbe-0de0-40d1-b4f7-642ae3854021 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99682024-11-25T19:40:29.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f4caefbe-0de0-40d1-b4f7-642ae3854021 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99692024-11-25T19:40:29.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f4caefbe-0de0-40d1-b4f7-642ae3854021 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99702024-11-25T19:40:30.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a770dc46-11b8-4ef9-8a01-8030dce19139 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99712024-11-25T19:40:30.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a770dc46-11b8-4ef9-8a01-8030dce19139 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99722024-11-25T19:40:30.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a770dc46-11b8-4ef9-8a01-8030dce19139 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99732024-11-25T19:40:31.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 408e2186-83e3-434e-9f94-31ab78898e78 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99742024-11-25T19:40:31.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 408e2186-83e3-434e-9f94-31ab78898e78 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99752024-11-25T19:40:31.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 408e2186-83e3-434e-9f94-31ab78898e78 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99762024-11-25T19:40:32.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3dc81450-7ae8-431c-8a95-9a8f97c1d175 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99772024-11-25T19:40:32.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3dc81450-7ae8-431c-8a95-9a8f97c1d175 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99782024-11-25T19:40:32.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3dc81450-7ae8-431c-8a95-9a8f97c1d175 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99792024-11-25T19:40:32.287ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 488 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = e3080d24-3733-4d33-b104-676994708b2f response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
99802024-11-25T19:40:33.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 43f95cf9-df03-4f1a-a143-52a5e6217e5e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99812024-11-25T19:40:33.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 43f95cf9-df03-4f1a-a143-52a5e6217e5e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99822024-11-25T19:40:33.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 43f95cf9-df03-4f1a-a143-52a5e6217e5e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99832024-11-25T19:40:34.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ff4023a3-a767-4ccc-bfef-e6a682f9f5cf roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99842024-11-25T19:40:34.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ff4023a3-a767-4ccc-bfef-e6a682f9f5cf resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99852024-11-25T19:40:34.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ff4023a3-a767-4ccc-bfef-e6a682f9f5cf response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99862024-11-25T19:40:35.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ce623414-6b74-43cb-8261-977595a149e6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99872024-11-25T19:40:35.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ce623414-6b74-43cb-8261-977595a149e6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99882024-11-25T19:40:35.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ce623414-6b74-43cb-8261-977595a149e6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99892024-11-25T19:40:36.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5ceedd7-c852-4fdf-a2aa-aaa124b1ba12 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99902024-11-25T19:40:36.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5ceedd7-c852-4fdf-a2aa-aaa124b1ba12 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99912024-11-25T19:40:36.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d5ceedd7-c852-4fdf-a2aa-aaa124b1ba12 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
99922024-11-25T19:40:36.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
99932024-11-25T19:40:36.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99942024-11-25T19:40:36.850ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
99952024-11-25T19:40:36.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99962024-11-25T19:40:36.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99972024-11-25T19:40:36.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99982024-11-25T19:40:36.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99992024-11-25T19:40:36.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100002024-11-25T19:40:36.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100012024-11-25T19:40:36.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.430347ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100022024-11-25T19:40:36.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100032024-11-25T19:40:36.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100042024-11-25T19:40:36.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100052024-11-25T19:40:36.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100062024-11-25T19:40:36.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100072024-11-25T19:40:36.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100082024-11-25T19:40:36.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
100092024-11-25T19:40:36.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100102024-11-25T19:40:36.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100112024-11-25T19:40:36.872ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
100122024-11-25T19:40:36.872ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.794458ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
100132024-11-25T19:40:37.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 25204284-80d8-4c2e-959c-6913f424fe0b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100142024-11-25T19:40:37.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 25204284-80d8-4c2e-959c-6913f424fe0b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100152024-11-25T19:40:37.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 25204284-80d8-4c2e-959c-6913f424fe0b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100162024-11-25T19:40:38.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1c38e7c5-c796-45f3-9439-e1bd91d9a64d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100172024-11-25T19:40:38.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1c38e7c5-c796-45f3-9439-e1bd91d9a64d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100182024-11-25T19:40:38.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1c38e7c5-c796-45f3-9439-e1bd91d9a64d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100192024-11-25T19:40:39.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d3ffe432-97bd-4d01-8fad-156c318363d3 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100202024-11-25T19:40:39.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d3ffe432-97bd-4d01-8fad-156c318363d3 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100212024-11-25T19:40:39.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d3ffe432-97bd-4d01-8fad-156c318363d3 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100222024-11-25T19:40:40.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 15343d7f-8ebf-4242-9ce3-2d5686fc5c69 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100232024-11-25T19:40:40.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 15343d7f-8ebf-4242-9ce3-2d5686fc5c69 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100242024-11-25T19:40:40.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 15343d7f-8ebf-4242-9ce3-2d5686fc5c69 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100252024-11-25T19:40:41.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a2602c3c-a64a-4d17-b669-216141253f48 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100262024-11-25T19:40:41.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a2602c3c-a64a-4d17-b669-216141253f48 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100272024-11-25T19:40:41.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a2602c3c-a64a-4d17-b669-216141253f48 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100282024-11-25T19:40:42.287ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 504 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 06e72fff-3c83-463b-833e-4875c2816187 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
100292024-11-25T19:40:42.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 242106c4-11ac-4f63-a5be-3c045ab69cf4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100302024-11-25T19:40:42.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 242106c4-11ac-4f63-a5be-3c045ab69cf4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100312024-11-25T19:40:42.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 242106c4-11ac-4f63-a5be-3c045ab69cf4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100322024-11-25T19:40:43.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e0aba0ef-8e3d-4b17-9101-2ab1d6bbb8e8 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100332024-11-25T19:40:43.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e0aba0ef-8e3d-4b17-9101-2ab1d6bbb8e8 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100342024-11-25T19:40:43.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e0aba0ef-8e3d-4b17-9101-2ab1d6bbb8e8 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100352024-11-25T19:40:44.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1a7737b1-a472-4fe2-acd6-8255f047fe7c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100362024-11-25T19:40:44.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1a7737b1-a472-4fe2-acd6-8255f047fe7c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100372024-11-25T19:40:44.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1a7737b1-a472-4fe2-acd6-8255f047fe7c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100382024-11-25T19:40:45.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9bde6e67-5735-43c7-93de-a0b1a7624961 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100392024-11-25T19:40:45.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9bde6e67-5735-43c7-93de-a0b1a7624961 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100402024-11-25T19:40:45.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9bde6e67-5735-43c7-93de-a0b1a7624961 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100412024-11-25T19:40:46.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 18ffc044-b72d-4ed0-abcd-2a8ddf42a1d2 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100422024-11-25T19:40:46.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 18ffc044-b72d-4ed0-abcd-2a8ddf42a1d2 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100432024-11-25T19:40:46.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 18ffc044-b72d-4ed0-abcd-2a8ddf42a1d2 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
100442024-11-25T19:40:46.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 21f0d60e-7c01-4885-839b-0ff551900154 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
100452024-11-25T19:40:46.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 21f0d60e-7c01-4885-839b-0ff551900154 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
100462024-11-25T19:40:46.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 21f0d60e-7c01-4885-839b-0ff551900154 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
100472024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
100482024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
100492024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
100502024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100512024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
100522024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
100532024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100542024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
100552024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
100562024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
100572024-11-25T19:40:46.850ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
100582024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
100592024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100602024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
100612024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100622024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100632024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
100642024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
100652024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100662024-11-25T19:40:46.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
100672024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
100682024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100692024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
100702024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100712024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
100722024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
100732024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100742024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
100752024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
100762024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100772024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
100782024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100792024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
100802024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
100812024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100822024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100832024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
100842024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100852024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
100862024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100872024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
100882024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100892024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100902024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100912024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100922024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100932024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100942024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100952024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100962024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100972024-11-25T19:40:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100982024-11-25T19:40:46.853ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1672, tv_nsec: 397571397 } })
100992024-11-25T19:40:46.853ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
101002024-11-25T19:40:46.854ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.149631ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
101012024-11-25T19:40:46.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1672, tv_nsec: 398317611 } })
101022024-11-25T19:40:46.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
101032024-11-25T19:40:46.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.805405ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
101042024-11-25T19:40:46.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101052024-11-25T19:40:46.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.247013ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
101062024-11-25T19:40:46.855ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101072024-11-25T19:40:46.855ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
101082024-11-25T19:40:46.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101092024-11-25T19:40:46.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101102024-11-25T19:40:46.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101112024-11-25T19:40:46.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101122024-11-25T19:40:46.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101132024-11-25T19:40:46.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101142024-11-25T19:40:46.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101152024-11-25T19:40:46.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101162024-11-25T19:40:46.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101172024-11-25T19:40:46.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101182024-11-25T19:40:46.858ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101192024-11-25T19:40:46.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101202024-11-25T19:40:46.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101212024-11-25T19:40:46.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101222024-11-25T19:40:46.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101232024-11-25T19:40:46.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101242024-11-25T19:40:46.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
101252024-11-25T19:40:46.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101262024-11-25T19:40:46.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101272024-11-25T19:40:46.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
101282024-11-25T19:40:46.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101292024-11-25T19:40:46.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101302024-11-25T19:40:46.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101312024-11-25T19:40:46.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101322024-11-25T19:40:46.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101332024-11-25T19:40:46.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101342024-11-25T19:40:46.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101352024-11-25T19:40:46.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
101362024-11-25T19:40:46.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101372024-11-25T19:40:46.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101382024-11-25T19:40:46.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101392024-11-25T19:40:46.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101402024-11-25T19:40:46.865ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101412024-11-25T19:40:46.865ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
101422024-11-25T19:40:46.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101432024-11-25T19:40:46.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101442024-11-25T19:40:46.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101452024-11-25T19:40:46.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101462024-11-25T19:40:46.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101472024-11-25T19:40:46.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101482024-11-25T19:40:46.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101492024-11-25T19:40:46.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101502024-11-25T19:40:46.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101512024-11-25T19:40:46.867ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1672, tv_nsec: 411710814 } })
101522024-11-25T19:40:46.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101532024-11-25T19:40:46.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101542024-11-25T19:40:46.868ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
101552024-11-25T19:40:46.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 17.133976ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
101562024-11-25T19:40:46.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101572024-11-25T19:40:46.873ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
101582024-11-25T19:40:46.873ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 22.187816ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
101592024-11-25T19:40:46.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
101602024-11-25T19:40:46.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101612024-11-25T19:40:46.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101622024-11-25T19:40:46.891ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
101632024-11-25T19:40:46.891ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.355002ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
101642024-11-25T19:40:46.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.518255ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101652024-11-25T19:40:46.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101662024-11-25T19:40:46.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101672024-11-25T19:40:46.893ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101682024-11-25T19:40:46.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101692024-11-25T19:40:46.894ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101702024-11-25T19:40:46.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101712024-11-25T19:40:46.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101722024-11-25T19:40:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
101732024-11-25T19:40:46.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101742024-11-25T19:40:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101752024-11-25T19:40:46.901ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 50.185245ms iteration = 20 status = 0
101762024-11-25T19:40:46.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101772024-11-25T19:40:46.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101782024-11-25T19:40:46.904ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101792024-11-25T19:40:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101802024-11-25T19:40:46.908ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101812024-11-25T19:40:46.909ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101822024-11-25T19:40:46.909ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
101832024-11-25T19:40:46.909ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 59.113239ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
101842024-11-25T19:40:46.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101852024-11-25T19:40:46.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101862024-11-25T19:40:46.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101872024-11-25T19:40:46.927ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 76.920659ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
101882024-11-25T19:40:46.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 84.59133ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
101892024-11-25T19:40:46.936ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
101902024-11-25T19:40:46.936ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101912024-11-25T19:40:46.937ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e1510c2-66f5-4e41-9f8e-e531ff7fd807", "content-length": "26", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
101922024-11-25T19:40:46.937ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101932024-11-25T19:40:46.938ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
101942024-11-25T19:40:46.938ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101952024-11-25T19:40:46.938ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e18abef9-236d-4279-8570-ea9f0bee6c0f", "content-length": "26", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
101962024-11-25T19:40:46.938ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101972024-11-25T19:40:46.938ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
101982024-11-25T19:40:46.940ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
101992024-11-25T19:40:46.942ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102002024-11-25T19:40:46.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102012024-11-25T19:40:46.944ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102022024-11-25T19:40:46.945ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 94.673977ms iteration = 22 status = {"physical_disks_added":0}
102032024-11-25T19:40:46.946ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102042024-11-25T19:40:46.946ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102052024-11-25T19:40:46.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102062024-11-25T19:40:46.948ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102072024-11-25T19:40:46.950ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102082024-11-25T19:40:46.950ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102092024-11-25T19:40:46.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102102024-11-25T19:40:46.965ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
102112024-11-25T19:40:46.965ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102122024-11-25T19:40:46.965ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fcf2f45-1f59-4d4f-a000-f637ce848f65", "content-length": "26", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
102132024-11-25T19:40:46.965ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102142024-11-25T19:40:46.967ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
102152024-11-25T19:40:47.063ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
102162024-11-25T19:40:47.063ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102172024-11-25T19:40:47.064ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a478888-3d32-4f65-99e1-16f558371ace", "content-length": "372", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
102182024-11-25T19:40:47.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102192024-11-25T19:40:47.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102202024-11-25T19:40:47.074ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
102212024-11-25T19:40:47.074ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "95b3511f-5f66-4fab-bcfd-e0a4771be519", "content-length": "1", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
102222024-11-25T19:40:47.076ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102232024-11-25T19:40:47.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102242024-11-25T19:40:47.078ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 227.583585ms iteration = 20 status = null
102252024-11-25T19:40:47.086ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 235.528281ms iteration = 20 status = {}
102262024-11-25T19:40:47.090ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
102272024-11-25T19:40:47.090ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "caa3cd0b-e9af-4880-bf20-5017a02ec0cc", "content-length": "691", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
102282024-11-25T19:40:47.090ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
102292024-11-25T19:40:47.090ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
102302024-11-25T19:40:47.090ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
102312024-11-25T19:40:47.093ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 242.223592ms iteration = 20 status = {}
102322024-11-25T19:40:47.128ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
102332024-11-25T19:40:47.128ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
102342024-11-25T19:40:47.128ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2ee5e924-2a4e-467a-8ec8-98c6598835b0", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
102352024-11-25T19:40:47.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102362024-11-25T19:40:47.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102372024-11-25T19:40:47.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102382024-11-25T19:40:47.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102392024-11-25T19:40:47.135ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102402024-11-25T19:40:47.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102412024-11-25T19:40:47.138ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
102422024-11-25T19:40:47.138ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102432024-11-25T19:40:47.138ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "38a1e057-a238-4491-a68f-90a18a7c0bbe", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
102442024-11-25T19:40:47.140ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 289.422718ms iteration = 20 status = {}
102452024-11-25T19:40:47.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102462024-11-25T19:40:47.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102472024-11-25T19:40:47.162ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
102482024-11-25T19:40:47.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102492024-11-25T19:40:47.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102502024-11-25T19:40:47.173ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
102512024-11-25T19:40:47.173ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "04ce083e-0175-4010-90b1-0328f60b9b6c", "content-length": "134", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
102522024-11-25T19:40:47.173ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
102532024-11-25T19:40:47.173ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
102542024-11-25T19:40:47.174ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
102552024-11-25T19:40:47.174ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
102562024-11-25T19:40:47.174ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102572024-11-25T19:40:47.174ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102582024-11-25T19:40:47.174ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102592024-11-25T19:40:47.174ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102602024-11-25T19:40:47.174ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102612024-11-25T19:40:47.174ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102622024-11-25T19:40:47.174ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
102632024-11-25T19:40:47.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102642024-11-25T19:40:47.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102652024-11-25T19:40:47.177ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
102662024-11-25T19:40:47.177ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "094a8216-ccc8-4651-8892-57a74e8f1b74", "content-length": "2", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
102672024-11-25T19:40:47.177ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
102682024-11-25T19:40:47.177ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "eba570f2-0d25-42cf-b404-f6defd4a4955", "content-length": "51", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
102692024-11-25T19:40:47.177ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
102702024-11-25T19:40:47.177ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
102712024-11-25T19:40:47.271ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f784b0da-b341-4112-890f-c03148775728", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
102722024-11-25T19:40:47.271ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
102732024-11-25T19:40:47.271ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
102742024-11-25T19:40:47.272ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "df202f2e-5be9-4d89-a699-d53679d4aba5", "content-length": "682", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
102752024-11-25T19:40:47.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102762024-11-25T19:40:47.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102772024-11-25T19:40:47.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102782024-11-25T19:40:47.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102792024-11-25T19:40:47.283ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102802024-11-25T19:40:47.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102812024-11-25T19:40:47.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102822024-11-25T19:40:47.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102832024-11-25T19:40:47.297ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 446.638683ms iteration = 20 status = {}
102842024-11-25T19:40:47.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a034d076-d0cf-409c-b30a-30d71be44351 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
102852024-11-25T19:40:47.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a034d076-d0cf-409c-b30a-30d71be44351 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
102862024-11-25T19:40:47.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a034d076-d0cf-409c-b30a-30d71be44351 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
102872024-11-25T19:40:48.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aa57aa52-cf34-43b3-9453-94c0da298b8b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
102882024-11-25T19:40:48.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aa57aa52-cf34-43b3-9453-94c0da298b8b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
102892024-11-25T19:40:48.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aa57aa52-cf34-43b3-9453-94c0da298b8b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
102902024-11-25T19:40:49.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a64b6a68-a3d9-4be6-b9ca-f12ef44c3e2f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
102912024-11-25T19:40:49.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a64b6a68-a3d9-4be6-b9ca-f12ef44c3e2f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
102922024-11-25T19:40:49.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a64b6a68-a3d9-4be6-b9ca-f12ef44c3e2f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
102932024-11-25T19:40:50.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9cdf93de-b465-48bf-85bf-c3daafcc0b24 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
102942024-11-25T19:40:50.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9cdf93de-b465-48bf-85bf-c3daafcc0b24 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
102952024-11-25T19:40:50.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9cdf93de-b465-48bf-85bf-c3daafcc0b24 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
102962024-11-25T19:40:51.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 195af841-a7e7-4fcd-945e-e7c7debf19b7 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
102972024-11-25T19:40:51.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 195af841-a7e7-4fcd-945e-e7c7debf19b7 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
102982024-11-25T19:40:51.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 195af841-a7e7-4fcd-945e-e7c7debf19b7 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
102992024-11-25T19:40:52.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 500 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 65695363-fdbf-4246-99a9-8d920564e0f8 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
103002024-11-25T19:40:52.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0710584e-d5b5-4829-9ed6-5305753729bb roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103012024-11-25T19:40:52.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0710584e-d5b5-4829-9ed6-5305753729bb resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103022024-11-25T19:40:52.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0710584e-d5b5-4829-9ed6-5305753729bb response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103032024-11-25T19:40:53.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 88e2ddea-fdfc-4dd7-9708-8805bdd5d435 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103042024-11-25T19:40:53.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 88e2ddea-fdfc-4dd7-9708-8805bdd5d435 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103052024-11-25T19:40:53.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 88e2ddea-fdfc-4dd7-9708-8805bdd5d435 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103062024-11-25T19:40:54.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5a5058ee-4ba1-4b1f-8abd-848883118d1e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103072024-11-25T19:40:54.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5a5058ee-4ba1-4b1f-8abd-848883118d1e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103082024-11-25T19:40:54.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5a5058ee-4ba1-4b1f-8abd-848883118d1e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103092024-11-25T19:40:55.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8540e20a-d429-4773-a8df-ff1224d9baa9 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103102024-11-25T19:40:55.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8540e20a-d429-4773-a8df-ff1224d9baa9 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103112024-11-25T19:40:55.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8540e20a-d429-4773-a8df-ff1224d9baa9 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103122024-11-25T19:40:56.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c4c89d5e-da93-4ff2-8552-c582488c63e5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103132024-11-25T19:40:56.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c4c89d5e-da93-4ff2-8552-c582488c63e5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103142024-11-25T19:40:56.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c4c89d5e-da93-4ff2-8552-c582488c63e5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103152024-11-25T19:40:56.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
103162024-11-25T19:40:56.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
103172024-11-25T19:40:56.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103182024-11-25T19:40:56.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103192024-11-25T19:40:56.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103202024-11-25T19:40:56.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103212024-11-25T19:40:56.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103222024-11-25T19:40:56.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103232024-11-25T19:40:56.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103242024-11-25T19:40:56.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103252024-11-25T19:40:56.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103262024-11-25T19:40:56.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103272024-11-25T19:40:56.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.979698ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103282024-11-25T19:40:56.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103292024-11-25T19:40:56.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103302024-11-25T19:40:56.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103312024-11-25T19:40:56.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
103322024-11-25T19:40:56.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103332024-11-25T19:40:56.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103342024-11-25T19:40:56.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
103352024-11-25T19:40:56.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.064833ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
103362024-11-25T19:40:57.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d47d041f-17e9-4977-940a-7d6225580675 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103372024-11-25T19:40:57.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d47d041f-17e9-4977-940a-7d6225580675 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103382024-11-25T19:40:57.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d47d041f-17e9-4977-940a-7d6225580675 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103392024-11-25T19:40:58.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 56174622-cc46-4158-a436-cd117a63bca9 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103402024-11-25T19:40:58.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 56174622-cc46-4158-a436-cd117a63bca9 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103412024-11-25T19:40:58.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 56174622-cc46-4158-a436-cd117a63bca9 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103422024-11-25T19:40:59.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4da46509-5874-460c-a84e-4e6ec7dd3222 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103432024-11-25T19:40:59.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4da46509-5874-460c-a84e-4e6ec7dd3222 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103442024-11-25T19:40:59.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2635 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4da46509-5874-460c-a84e-4e6ec7dd3222 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103452024-11-25T19:41:00.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0736e031-5133-4012-96f9-bf65473e290c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103462024-11-25T19:41:00.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0736e031-5133-4012-96f9-bf65473e290c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103472024-11-25T19:41:00.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0736e031-5133-4012-96f9-bf65473e290c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103482024-11-25T19:41:01.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c09d9a0a-2112-45e8-a96f-e280fcc8abf5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103492024-11-25T19:41:01.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c09d9a0a-2112-45e8-a96f-e280fcc8abf5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103502024-11-25T19:41:01.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c09d9a0a-2112-45e8-a96f-e280fcc8abf5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103512024-11-25T19:41:02.287ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 482 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = e94e879f-a0b2-4e6c-bcf1-1470dcb89019 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
103522024-11-25T19:41:02.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d45d9e52-cad0-42b4-aa61-274d7403e04c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103532024-11-25T19:41:02.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d45d9e52-cad0-42b4-aa61-274d7403e04c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103542024-11-25T19:41:02.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d45d9e52-cad0-42b4-aa61-274d7403e04c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103552024-11-25T19:41:03.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 67a67b21-b8f0-480b-b927-4ef997a6769a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103562024-11-25T19:41:03.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 67a67b21-b8f0-480b-b927-4ef997a6769a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103572024-11-25T19:41:03.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 67a67b21-b8f0-480b-b927-4ef997a6769a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103582024-11-25T19:41:04.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0c167fa6-68f6-48ac-a95b-1739c5b04be9 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103592024-11-25T19:41:04.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0c167fa6-68f6-48ac-a95b-1739c5b04be9 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103602024-11-25T19:41:04.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0c167fa6-68f6-48ac-a95b-1739c5b04be9 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103612024-11-25T19:41:05.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad88b7cb-5dde-47db-8321-08f789318947 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103622024-11-25T19:41:05.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad88b7cb-5dde-47db-8321-08f789318947 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103632024-11-25T19:41:05.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad88b7cb-5dde-47db-8321-08f789318947 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103642024-11-25T19:41:06.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
103652024-11-25T19:41:06.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103662024-11-25T19:41:06.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
103672024-11-25T19:41:06.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103682024-11-25T19:41:06.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103692024-11-25T19:41:06.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103702024-11-25T19:41:06.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103712024-11-25T19:41:06.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103722024-11-25T19:41:06.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103732024-11-25T19:41:06.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103742024-11-25T19:41:06.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103752024-11-25T19:41:06.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103762024-11-25T19:41:06.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103772024-11-25T19:41:06.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
103782024-11-25T19:41:06.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103792024-11-25T19:41:06.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103802024-11-25T19:41:06.872ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
103812024-11-25T19:41:06.872ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.37396ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
103822024-11-25T19:41:06.879ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103832024-11-25T19:41:06.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103842024-11-25T19:41:06.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.825285ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103852024-11-25T19:41:06.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dd088b26-a979-4ffc-bf8d-f3c6b3dca0f6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103862024-11-25T19:41:06.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dd088b26-a979-4ffc-bf8d-f3c6b3dca0f6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103872024-11-25T19:41:06.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dd088b26-a979-4ffc-bf8d-f3c6b3dca0f6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103882024-11-25T19:41:07.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 036a34dd-4e98-493c-80d2-cd5131b78423 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
103892024-11-25T19:41:07.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 036a34dd-4e98-493c-80d2-cd5131b78423 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
103902024-11-25T19:41:07.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 036a34dd-4e98-493c-80d2-cd5131b78423 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
103912024-11-25T19:41:07.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 3af62ffe-95e7-4415-8631-20c9d921895e roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
103922024-11-25T19:41:07.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 3af62ffe-95e7-4415-8631-20c9d921895e resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
103932024-11-25T19:41:07.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 3af62ffe-95e7-4415-8631-20c9d921895e response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
103942024-11-25T19:41:08.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d13ae129-1078-4bc0-9b6c-7a6ac76cd6fb roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103952024-11-25T19:41:08.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d13ae129-1078-4bc0-9b6c-7a6ac76cd6fb resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103962024-11-25T19:41:08.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d13ae129-1078-4bc0-9b6c-7a6ac76cd6fb response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103972024-11-25T19:41:09.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bfdeb4c4-dac7-4929-8241-9744a31d52f9 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103982024-11-25T19:41:09.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bfdeb4c4-dac7-4929-8241-9744a31d52f9 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
103992024-11-25T19:41:09.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bfdeb4c4-dac7-4929-8241-9744a31d52f9 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104002024-11-25T19:41:10.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8adf7044-4a70-4b03-8090-c812c5a20fb8 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104012024-11-25T19:41:10.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8adf7044-4a70-4b03-8090-c812c5a20fb8 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104022024-11-25T19:41:10.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8adf7044-4a70-4b03-8090-c812c5a20fb8 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104032024-11-25T19:41:11.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 21de0cb6-da5e-4d8e-8e08-1d1fd45689c3 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104042024-11-25T19:41:11.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 21de0cb6-da5e-4d8e-8e08-1d1fd45689c3 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104052024-11-25T19:41:11.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 21de0cb6-da5e-4d8e-8e08-1d1fd45689c3 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104062024-11-25T19:41:12.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cc788b49-2000-436c-944d-7fbef58ee685 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104072024-11-25T19:41:12.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cc788b49-2000-436c-944d-7fbef58ee685 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104082024-11-25T19:41:12.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cc788b49-2000-436c-944d-7fbef58ee685 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104092024-11-25T19:41:12.287ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 465 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 8ee70e71-833a-41e8-b1b8-75fe805ce4a6 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
104102024-11-25T19:41:13.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = deab3f47-6af0-45ee-8fe4-ff8cfc5fcafe roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104112024-11-25T19:41:13.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = deab3f47-6af0-45ee-8fe4-ff8cfc5fcafe resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104122024-11-25T19:41:13.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = deab3f47-6af0-45ee-8fe4-ff8cfc5fcafe response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104132024-11-25T19:41:14.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = af71c0da-b89c-4ed8-bea8-6331311f3e08 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104142024-11-25T19:41:14.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = af71c0da-b89c-4ed8-bea8-6331311f3e08 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104152024-11-25T19:41:14.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = af71c0da-b89c-4ed8-bea8-6331311f3e08 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104162024-11-25T19:41:15.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 82cd7c39-9dc4-4ba0-8bb7-b8c4f7a5effb roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104172024-11-25T19:41:15.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 82cd7c39-9dc4-4ba0-8bb7-b8c4f7a5effb resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104182024-11-25T19:41:15.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 82cd7c39-9dc4-4ba0-8bb7-b8c4f7a5effb response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104192024-11-25T19:41:16.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c331b42a-7e78-4c2c-b4cd-c118e6a1461c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104202024-11-25T19:41:16.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c331b42a-7e78-4c2c-b4cd-c118e6a1461c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104212024-11-25T19:41:16.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c331b42a-7e78-4c2c-b4cd-c118e6a1461c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
104222024-11-25T19:41:16.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 1951e82a-ee16-4477-a6be-143887a9df74 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
104232024-11-25T19:41:16.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 1951e82a-ee16-4477-a6be-143887a9df74 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
104242024-11-25T19:41:16.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 1951e82a-ee16-4477-a6be-143887a9df74 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
104252024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
104262024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
104272024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
104282024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
104292024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104302024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
104312024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
104322024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
104332024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
104342024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
104352024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
104362024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
104372024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
104382024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
104392024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104402024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104412024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
104422024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
104432024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
104442024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104452024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104462024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
104472024-11-25T19:41:16.851ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
104482024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104492024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
104502024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104512024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
104522024-11-25T19:41:16.851ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
104532024-11-25T19:41:16.851ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
104542024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
104552024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
104562024-11-25T19:41:16.851ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
104572024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
104582024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
104592024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
104602024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
104612024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
104622024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
104632024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
104642024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104652024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
104662024-11-25T19:41:16.851ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
104672024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104682024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
104692024-11-25T19:41:16.851ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:31:16.851303441 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
104702024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
104712024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
104722024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
104732024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
104742024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
104752024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
104762024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
104772024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
104782024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104792024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104802024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
104812024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104822024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
104832024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104842024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
104852024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104862024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
104872024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
104882024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
104892024-11-25T19:41:16.851ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
104902024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
104912024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
104922024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
104932024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
104942024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
104952024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
104962024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104972024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104982024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104992024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
105002024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
105012024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
105022024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105032024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105042024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105052024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105062024-11-25T19:41:16.851ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1702, tv_nsec: 395652569 } })
105072024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105082024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
105092024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
105102024-11-25T19:41:16.851ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
105112024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
105122024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105132024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105142024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
105152024-11-25T19:41:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105162024-11-25T19:41:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105172024-11-25T19:41:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105182024-11-25T19:41:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105192024-11-25T19:41:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105202024-11-25T19:41:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
105212024-11-25T19:41:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105222024-11-25T19:41:16.852ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1702, tv_nsec: 395830222 } })
105232024-11-25T19:41:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105242024-11-25T19:41:16.852ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
105252024-11-25T19:41:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.218544ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
105262024-11-25T19:41:16.852ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
105272024-11-25T19:41:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.079671ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
105282024-11-25T19:41:16.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105292024-11-25T19:41:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105302024-11-25T19:41:16.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105312024-11-25T19:41:16.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105322024-11-25T19:41:16.855ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.314724ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
105332024-11-25T19:41:16.856ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1702, tv_nsec: 400231029 } })
105342024-11-25T19:41:16.856ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
105352024-11-25T19:41:16.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105362024-11-25T19:41:16.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105372024-11-25T19:41:16.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105382024-11-25T19:41:16.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
105392024-11-25T19:41:16.858ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105402024-11-25T19:41:16.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105412024-11-25T19:41:16.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105422024-11-25T19:41:16.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105432024-11-25T19:41:16.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105442024-11-25T19:41:16.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105452024-11-25T19:41:16.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
105462024-11-25T19:41:16.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105472024-11-25T19:41:16.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105482024-11-25T19:41:16.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105492024-11-25T19:41:16.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105502024-11-25T19:41:16.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105512024-11-25T19:41:16.865ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.343081ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
105522024-11-25T19:41:16.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105532024-11-25T19:41:16.866ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1702, tv_nsec: 410676414 } })
105542024-11-25T19:41:16.866ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:31:16.851303441 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
105552024-11-25T19:41:16.866ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.600556ms iteration = 11 status = {"expiration":"2024-11-25T19:31:16.851303441Z","pruned":[]}
105562024-11-25T19:41:16.867ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
105572024-11-25T19:41:16.869ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105582024-11-25T19:41:16.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105592024-11-25T19:41:16.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
105602024-11-25T19:41:16.869ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105612024-11-25T19:41:16.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105622024-11-25T19:41:16.871ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105632024-11-25T19:41:16.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105642024-11-25T19:41:16.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105652024-11-25T19:41:16.872ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105662024-11-25T19:41:16.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105672024-11-25T19:41:16.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105682024-11-25T19:41:16.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105692024-11-25T19:41:16.875ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105702024-11-25T19:41:16.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105712024-11-25T19:41:16.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
105722024-11-25T19:41:16.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105732024-11-25T19:41:16.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105742024-11-25T19:41:16.891ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
105752024-11-25T19:41:16.891ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
105762024-11-25T19:41:16.891ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 40.30377ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
105772024-11-25T19:41:16.892ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.376132ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
105782024-11-25T19:41:16.895ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105792024-11-25T19:41:16.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105802024-11-25T19:41:16.905ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105812024-11-25T19:41:16.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105822024-11-25T19:41:16.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 54.146983ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
105832024-11-25T19:41:16.906ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105842024-11-25T19:41:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
105852024-11-25T19:41:16.907ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
105862024-11-25T19:41:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
105872024-11-25T19:41:16.908ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105882024-11-25T19:41:16.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.065209ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
105892024-11-25T19:41:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105902024-11-25T19:41:16.908ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105912024-11-25T19:41:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105922024-11-25T19:41:16.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105932024-11-25T19:41:16.909ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105942024-11-25T19:41:16.910ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105952024-11-25T19:41:16.910ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
105962024-11-25T19:41:16.910ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105972024-11-25T19:41:16.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105982024-11-25T19:41:16.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105992024-11-25T19:41:16.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106002024-11-25T19:41:16.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106012024-11-25T19:41:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106022024-11-25T19:41:16.911ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
106032024-11-25T19:41:16.911ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 60.502457ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
106042024-11-25T19:41:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106052024-11-25T19:41:16.913ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106062024-11-25T19:41:16.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106072024-11-25T19:41:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
106082024-11-25T19:41:16.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106092024-11-25T19:41:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106102024-11-25T19:41:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106112024-11-25T19:41:16.915ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106122024-11-25T19:41:16.915ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106132024-11-25T19:41:16.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106142024-11-25T19:41:16.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106152024-11-25T19:41:16.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.603047ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106162024-11-25T19:41:16.917ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
106172024-11-25T19:41:16.917ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
106182024-11-25T19:41:16.917ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 66.204309ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
106192024-11-25T19:41:16.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106202024-11-25T19:41:16.919ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
106212024-11-25T19:41:16.919ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
106222024-11-25T19:41:16.919ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
106232024-11-25T19:41:16.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106242024-11-25T19:41:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
106252024-11-25T19:41:16.919ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
106262024-11-25T19:41:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106272024-11-25T19:41:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
106282024-11-25T19:41:16.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106292024-11-25T19:41:16.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106302024-11-25T19:41:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106312024-11-25T19:41:16.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106322024-11-25T19:41:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
106332024-11-25T19:41:16.923ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106342024-11-25T19:41:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106352024-11-25T19:41:16.928ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106362024-11-25T19:41:16.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106372024-11-25T19:41:16.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106382024-11-25T19:41:16.932ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106392024-11-25T19:41:16.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106402024-11-25T19:41:16.932ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(50f178f1-acf7-478b-9ba7-68e1b53861af, 0), (11c9f838-30d8-4855-9f92-f2b664ec0890, 0), (22dda696-7685-4d0a-9656-e52449f525ae, 0)]
106412024-11-25T19:41:16.933ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1702, tv_nsec: 477169118 } })
106422024-11-25T19:41:16.933ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106432024-11-25T19:41:16.934ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1702, tv_nsec: 477913433 } })
106442024-11-25T19:41:16.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106452024-11-25T19:41:16.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106462024-11-25T19:41:16.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106472024-11-25T19:41:16.934ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
106482024-11-25T19:41:16.934ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106492024-11-25T19:41:16.934ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
106502024-11-25T19:41:16.934ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
106512024-11-25T19:41:16.934ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
106522024-11-25T19:41:16.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106532024-11-25T19:41:16.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106542024-11-25T19:41:16.936ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106552024-11-25T19:41:16.936ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
106562024-11-25T19:41:16.936ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
106572024-11-25T19:41:16.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106582024-11-25T19:41:16.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106592024-11-25T19:41:16.937ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106602024-11-25T19:41:16.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106612024-11-25T19:41:16.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
106622024-11-25T19:41:16.937ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106632024-11-25T19:41:16.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106642024-11-25T19:41:16.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
106652024-11-25T19:41:16.938ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106662024-11-25T19:41:16.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106672024-11-25T19:41:16.939ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
106682024-11-25T19:41:16.939ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.901275ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
106692024-11-25T19:41:16.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
106702024-11-25T19:41:16.940ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106712024-11-25T19:41:16.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106722024-11-25T19:41:16.941ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
106732024-11-25T19:41:16.941ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.143308ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
106742024-11-25T19:41:16.942ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106752024-11-25T19:41:16.943ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
106762024-11-25T19:41:16.943ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106772024-11-25T19:41:16.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
106782024-11-25T19:41:16.943ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106792024-11-25T19:41:16.943ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106802024-11-25T19:41:16.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106812024-11-25T19:41:16.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106822024-11-25T19:41:16.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106832024-11-25T19:41:16.944ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
106842024-11-25T19:41:16.944ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
106852024-11-25T19:41:16.944ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106862024-11-25T19:41:16.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106872024-11-25T19:41:16.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106882024-11-25T19:41:16.946ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106892024-11-25T19:41:16.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106902024-11-25T19:41:16.947ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106912024-11-25T19:41:16.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106922024-11-25T19:41:16.947ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106932024-11-25T19:41:16.948ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106942024-11-25T19:41:16.948ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106952024-11-25T19:41:16.949ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106962024-11-25T19:41:16.950ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
106972024-11-25T19:41:16.950ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
106982024-11-25T19:41:16.950ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
106992024-11-25T19:41:16.950ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 99.166786ms iteration = 11 status = {"generation":1}
107002024-11-25T19:41:16.951ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
107012024-11-25T19:41:16.951ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107022024-11-25T19:41:16.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107032024-11-25T19:41:16.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107042024-11-25T19:41:16.952ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107052024-11-25T19:41:16.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107062024-11-25T19:41:16.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
107072024-11-25T19:41:16.953ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107082024-11-25T19:41:16.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107092024-11-25T19:41:16.954ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
107102024-11-25T19:41:16.954ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
107112024-11-25T19:41:16.954ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
107122024-11-25T19:41:16.954ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 103.823876ms iteration = 11 status = {"generation":2}
107132024-11-25T19:41:16.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
107142024-11-25T19:41:16.955ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107152024-11-25T19:41:16.955ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 104.244655ms iteration = 21 status = 0
107162024-11-25T19:41:16.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107172024-11-25T19:41:16.957ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107182024-11-25T19:41:16.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107192024-11-25T19:41:16.960ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107202024-11-25T19:41:16.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107212024-11-25T19:41:16.962ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107222024-11-25T19:41:16.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107232024-11-25T19:41:16.964ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107242024-11-25T19:41:16.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107252024-11-25T19:41:16.966ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107262024-11-25T19:41:16.966ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
107272024-11-25T19:41:16.966ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107282024-11-25T19:41:16.966ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 114.876714ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
107292024-11-25T19:41:16.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107302024-11-25T19:41:16.969ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107312024-11-25T19:41:16.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107322024-11-25T19:41:16.992ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
107332024-11-25T19:41:16.996ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
107342024-11-25T19:41:16.996ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107352024-11-25T19:41:16.996ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c270468b-76e0-4ac7-84be-5e6b49ecb274", "content-length": "26", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107362024-11-25T19:41:16.996ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107372024-11-25T19:41:16.998ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107382024-11-25T19:41:16.998ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107392024-11-25T19:41:16.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107402024-11-25T19:41:17.000ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107412024-11-25T19:41:17.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107422024-11-25T19:41:17.003ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107432024-11-25T19:41:17.004ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
107442024-11-25T19:41:17.004ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 152.723926ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
107452024-11-25T19:41:17.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107462024-11-25T19:41:17.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107472024-11-25T19:41:17.011ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
107482024-11-25T19:41:17.011ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 160.195933ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
107492024-11-25T19:41:17.013ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107502024-11-25T19:41:17.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
107512024-11-25T19:41:17.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107522024-11-25T19:41:17.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107532024-11-25T19:41:17.018ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107542024-11-25T19:41:17.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107552024-11-25T19:41:17.023ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
107562024-11-25T19:41:17.023ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 172.818181ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
107572024-11-25T19:41:17.023ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107582024-11-25T19:41:17.023ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 172.661957ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
107592024-11-25T19:41:17.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107602024-11-25T19:41:17.043ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 192.838113ms iteration = 23 status = {"physical_disks_added":0}
107612024-11-25T19:41:17.136ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
107622024-11-25T19:41:17.136ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
107632024-11-25T19:41:17.136ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
107642024-11-25T19:41:17.137ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "feb05c1e-f0bc-478b-98b1-6bb87966e6f5", "content-length": "476", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107652024-11-25T19:41:17.137ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
107662024-11-25T19:41:17.137ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3cb9037-80b9-4d69-bb43-f6c0e69df56d", "content-length": "734", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107672024-11-25T19:41:17.137ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
107682024-11-25T19:41:17.138ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ea532df-d081-4f7b-90f1-235617bbc8ea", "content-length": "111", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107692024-11-25T19:41:17.138ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
107702024-11-25T19:41:17.139ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a3d480a-6f7b-4e21-a08c-fca3b4cad200", "content-length": "111", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107712024-11-25T19:41:17.139ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
107722024-11-25T19:41:17.139ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ad67cec-cf1c-4de8-8931-0b1ea1073529", "content-length": "167", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107732024-11-25T19:41:17.139ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
107742024-11-25T19:41:17.139ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbcd528d-93b8-4e02-bb50-fff83e9a083d", "content-length": "167", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107752024-11-25T19:41:17.140ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
107762024-11-25T19:41:17.140ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0632d0e-8feb-45a6-8ab2-ce8f44ebc2b5", "content-length": "175", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107772024-11-25T19:41:17.140ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
107782024-11-25T19:41:17.141ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "09da129c-5374-400e-8485-ec7cb227f340", "content-length": "175", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107792024-11-25T19:41:17.141ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
107802024-11-25T19:41:17.141ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c61115ec-0b49-4638-86f8-17fa92ddc89c", "content-length": "702", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107812024-11-25T19:41:17.141ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
107822024-11-25T19:41:17.141ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f1d78bf-b8f7-4bcb-9514-bc405e6c56b5", "content-length": "727", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107832024-11-25T19:41:17.141ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
107842024-11-25T19:41:17.141ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7135d5a-511d-4242-b8c9-fdfddf536809", "content-length": "729", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107852024-11-25T19:41:17.141ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
107862024-11-25T19:41:17.141ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6be0a24-1cea-47a2-a711-f61ea1b6f561", "content-length": "728", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107872024-11-25T19:41:17.141ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
107882024-11-25T19:41:17.142ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "43051ee3-0c52-43e7-9018-01eaee9a0ce9", "content-length": "722", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107892024-11-25T19:41:17.142ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
107902024-11-25T19:41:17.142ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba65517f-01a1-449f-8e60-c2fc83cb6e10", "content-length": "109", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107912024-11-25T19:41:17.142ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
107922024-11-25T19:41:17.143ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c2b6c6a-b8dd-432b-97c0-cc5c949e8c7b", "content-length": "109", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107932024-11-25T19:41:17.143ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
107942024-11-25T19:41:17.143ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b73439d-bbec-4343-9206-61f8fe79f8c3", "content-length": "169", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107952024-11-25T19:41:17.143ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
107962024-11-25T19:41:17.143ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "51c1000c-e2f1-4bba-b559-7fc5a4f9d7b4", "content-length": "169", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107972024-11-25T19:41:17.143ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
107982024-11-25T19:41:17.144ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc7dbd64-a7eb-4f80-a15b-aacabd696288", "content-length": "178", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
107992024-11-25T19:41:17.144ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
108002024-11-25T19:41:17.144ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "de124d50-47bb-4439-8561-be015131dff1", "content-length": "178", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
108012024-11-25T19:41:17.144ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
108022024-11-25T19:41:17.144ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cda52331-bed4-4cb8-8788-6ae0f3cfe81b", "content-length": "702", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
108032024-11-25T19:41:17.144ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
108042024-11-25T19:41:17.144ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "534533e8-8a42-48d6-9411-b101dff38b77", "content-length": "727", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
108052024-11-25T19:41:17.144ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
108062024-11-25T19:41:17.145ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "98d365ef-d25a-44ab-94b6-0b998a5417d3", "content-length": "729", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
108072024-11-25T19:41:17.145ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
108082024-11-25T19:41:17.145ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "be874ec9-3e8f-4d8a-b00c-df20354860da", "content-length": "728", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
108092024-11-25T19:41:17.145ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
108102024-11-25T19:41:17.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
108112024-11-25T19:41:17.147ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
108122024-11-25T19:41:17.147ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108132024-11-25T19:41:17.148ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "36ecc272-a88a-4844-8d3b-2ea808512c57", "content-length": "26", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
108142024-11-25T19:41:17.148ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108152024-11-25T19:41:17.150ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
108162024-11-25T19:41:17.162ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
108172024-11-25T19:41:17.170ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108182024-11-25T19:41:17.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108192024-11-25T19:41:17.188ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
108202024-11-25T19:41:17.197ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
108212024-11-25T19:41:17.197ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108222024-11-25T19:41:17.202ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c54a159e-4804-4590-a9af-4f28f4a912d3", "content-length": "372", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
108232024-11-25T19:41:17.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108242024-11-25T19:41:17.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108252024-11-25T19:41:17.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108262024-11-25T19:41:17.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108272024-11-25T19:41:17.207ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108282024-11-25T19:41:17.208ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108292024-11-25T19:41:17.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108302024-11-25T19:41:17.210ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108312024-11-25T19:41:17.210ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108322024-11-25T19:41:17.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108332024-11-25T19:41:17.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e97f3377-8bd4-45ea-8ffe-90cb8d2a78f5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
108342024-11-25T19:41:17.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e97f3377-8bd4-45ea-8ffe-90cb8d2a78f5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
108352024-11-25T19:41:17.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e97f3377-8bd4-45ea-8ffe-90cb8d2a78f5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
108362024-11-25T19:41:17.248ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108372024-11-25T19:41:17.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108382024-11-25T19:41:17.256ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108392024-11-25T19:41:17.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
108402024-11-25T19:41:17.259ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
108412024-11-25T19:41:17.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
108422024-11-25T19:41:17.261ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108432024-11-25T19:41:17.263ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
108442024-11-25T19:41:17.263ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
108452024-11-25T19:41:17.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
108462024-11-25T19:41:17.264ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
108472024-11-25T19:41:17.264ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
108482024-11-25T19:41:17.265ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b2536e7b-09c7-45d5-9d66-f2975c5374a6", "date": "Mon, 25 Nov 2024 19:41:17 GMT"} })
108492024-11-25T19:41:17.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108502024-11-25T19:41:17.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108512024-11-25T19:41:17.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108522024-11-25T19:41:17.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108532024-11-25T19:41:17.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108542024-11-25T19:41:17.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108552024-11-25T19:41:17.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108562024-11-25T19:41:17.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108572024-11-25T19:41:17.271ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108582024-11-25T19:41:17.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108592024-11-25T19:41:17.275ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
108602024-11-25T19:41:17.275ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108612024-11-25T19:41:17.275ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a3daaa29-74a2-4ee5-83ec-9d03bfaa7190", "date": "Mon, 25 Nov 2024 19:41:17 GMT"} })
108622024-11-25T19:41:17.277ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 426.410066ms iteration = 21 status = {}
108632024-11-25T19:41:17.286ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108642024-11-25T19:41:17.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108652024-11-25T19:41:17.310ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
108662024-11-25T19:41:17.310ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108672024-11-25T19:41:17.310ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "98772b1a-4efa-4009-be2f-30694bd9be55", "content-length": "26", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
108682024-11-25T19:41:17.310ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108692024-11-25T19:41:17.312ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
108702024-11-25T19:41:17.358ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 507.912445ms iteration = 21 status = {}
108712024-11-25T19:41:17.369ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
108722024-11-25T19:41:17.369ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "045f097a-88f0-4c8e-9642-4a6e58f88075", "date": "Mon, 25 Nov 2024 19:41:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
108732024-11-25T19:41:17.369ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
108742024-11-25T19:41:17.371ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8cd9e9a2-501b-4024-be44-f176b1825857", "date": "Mon, 25 Nov 2024 19:41:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
108752024-11-25T19:41:17.371ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
108762024-11-25T19:41:17.372ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c103b9a2-8288-4966-8868-c32ad83b2add", "date": "Mon, 25 Nov 2024 19:41:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
108772024-11-25T19:41:17.372ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
108782024-11-25T19:41:17.374ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
108792024-11-25T19:41:17.374ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 523.308257ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
108802024-11-25T19:41:17.435ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
108812024-11-25T19:41:17.435ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7db07e7b-fefa-422f-a73d-6ec982f6707b", "content-length": "691", "date": "Mon, 25 Nov 2024 19:41:17 GMT"} })
108822024-11-25T19:41:17.435ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
108832024-11-25T19:41:17.435ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
108842024-11-25T19:41:17.435ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
108852024-11-25T19:41:17.435ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
108862024-11-25T19:41:17.436ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9118ac98-fb02-4816-8ec0-693efd051aaa", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108872024-11-25T19:41:17.436ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108882024-11-25T19:41:17.437ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
108892024-11-25T19:41:17.437ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
108902024-11-25T19:41:17.438ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "485616fe-b9f0-45a6-9ae3-badf98227573", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108912024-11-25T19:41:17.438ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108922024-11-25T19:41:17.438ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 587.121299ms iteration = 21 status = {}
108932024-11-25T19:41:17.439ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108942024-11-25T19:41:17.440ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108952024-11-25T19:41:17.440ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 589.2141ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
108962024-11-25T19:41:17.443ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
108972024-11-25T19:41:17.443ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108982024-11-25T19:41:17.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108992024-11-25T19:41:17.445ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109002024-11-25T19:41:17.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109012024-11-25T19:41:17.446ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
109022024-11-25T19:41:17.447ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "18e9e97d-a40c-43ab-975f-8a5b4b02c2a1", "content-length": "1", "date": "Mon, 25 Nov 2024 19:41:17 GMT"} })
109032024-11-25T19:41:17.448ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
109042024-11-25T19:41:17.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
109052024-11-25T19:41:17.450ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 598.739857ms iteration = 21 status = null
109062024-11-25T19:41:17.485ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109072024-11-25T19:41:17.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109082024-11-25T19:41:17.486ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109092024-11-25T19:41:17.492ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109102024-11-25T19:41:17.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109112024-11-25T19:41:17.493ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
109122024-11-25T19:41:17.493ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109132024-11-25T19:41:17.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109142024-11-25T19:41:17.497ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
109152024-11-25T19:41:17.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109162024-11-25T19:41:17.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109172024-11-25T19:41:17.501ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109182024-11-25T19:41:17.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109192024-11-25T19:41:17.503ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109202024-11-25T19:41:17.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109212024-11-25T19:41:17.505ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109222024-11-25T19:41:17.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109232024-11-25T19:41:17.507ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109242024-11-25T19:41:17.507ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
109252024-11-25T19:41:17.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109262024-11-25T19:41:17.508ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a0da134-a272-4d51-b58d-c94ac334e59b", "content-length": "134", "date": "Mon, 25 Nov 2024 19:41:17 GMT"} })
109272024-11-25T19:41:17.508ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
109282024-11-25T19:41:17.508ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
109292024-11-25T19:41:17.508ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
109302024-11-25T19:41:17.508ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
109312024-11-25T19:41:17.508ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109322024-11-25T19:41:17.508ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109332024-11-25T19:41:17.508ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109342024-11-25T19:41:17.508ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109352024-11-25T19:41:17.508ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109362024-11-25T19:41:17.508ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109372024-11-25T19:41:17.508ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
109382024-11-25T19:41:17.508ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109392024-11-25T19:41:17.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109402024-11-25T19:41:17.510ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109412024-11-25T19:41:17.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109422024-11-25T19:41:17.511ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
109432024-11-25T19:41:17.511ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "86a97e23-edea-4922-bb0a-3766f40ed63c", "content-length": "2", "date": "Mon, 25 Nov 2024 19:41:17 GMT"} })
109442024-11-25T19:41:17.511ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
109452024-11-25T19:41:17.511ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a727e1b-dde3-4ede-bde0-d1c99f3d42c0", "content-length": "51", "date": "Mon, 25 Nov 2024 19:41:17 GMT"} })
109462024-11-25T19:41:17.511ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
109472024-11-25T19:41:17.511ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
109482024-11-25T19:41:17.512ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109492024-11-25T19:41:17.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109502024-11-25T19:41:17.513ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109512024-11-25T19:41:17.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109522024-11-25T19:41:17.515ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109532024-11-25T19:41:17.519ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
109542024-11-25T19:41:17.519ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109552024-11-25T19:41:17.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109562024-11-25T19:41:17.520ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109572024-11-25T19:41:17.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109582024-11-25T19:41:17.522ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109592024-11-25T19:41:17.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109602024-11-25T19:41:17.523ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109612024-11-25T19:41:17.526ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
109622024-11-25T19:41:17.526ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109632024-11-25T19:41:17.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109642024-11-25T19:41:17.532ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
109652024-11-25T19:41:17.532ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109662024-11-25T19:41:17.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109672024-11-25T19:41:17.534ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109682024-11-25T19:41:17.536ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
109692024-11-25T19:41:17.536ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109702024-11-25T19:41:17.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109712024-11-25T19:41:17.537ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
109722024-11-25T19:41:17.537ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
109732024-11-25T19:41:17.537ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
109742024-11-25T19:41:17.624ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "18aa15e2-11b6-4b60-a3ca-afe93b7efb25", "date": "Mon, 25 Nov 2024 19:41:17 GMT"} })
109752024-11-25T19:41:17.624ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
109762024-11-25T19:41:17.624ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
109772024-11-25T19:41:17.632ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "be93b4af-9354-4eb0-89af-fb4d87a704b3", "content-length": "682", "date": "Mon, 25 Nov 2024 19:41:17 GMT"} })
109782024-11-25T19:41:17.632ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109792024-11-25T19:41:17.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109802024-11-25T19:41:17.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109812024-11-25T19:41:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109822024-11-25T19:41:17.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109832024-11-25T19:41:17.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109842024-11-25T19:41:17.640ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109852024-11-25T19:41:17.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109862024-11-25T19:41:17.647ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 38711855-ef69-4d79-bb75-aebd85b1280b, time_created: 2024-11-25T19:31:33.165388Z, time_modified: 2024-11-25T19:31:33.165388Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
109872024-11-25T19:41:17.647ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
109882024-11-25T19:41:17.647ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109892024-11-25T19:41:17.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109902024-11-25T19:41:17.648ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 797.479856ms iteration = 21 status = {}
109912024-11-25T19:41:17.649ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109922024-11-25T19:41:17.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109932024-11-25T19:41:17.651ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109942024-11-25T19:41:17.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
109952024-11-25T19:41:17.684ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
109962024-11-25T19:41:17.689ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "d0620384-1e59-44fb-b04a-e8aa14cacba4", "date": "Mon, 25 Nov 2024 19:41:17 GMT"} })
109972024-11-25T19:41:17.691ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
109982024-11-25T19:41:17.691ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 839.805597ms
109992024-11-25T19:41:17.691ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 839.818227ms iteration = 3 status = {}
110002024-11-25T19:41:17.743ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "942ce048-ab52-4feb-932b-28cced510aa4", "content-length": "30762", "date": "Mon, 25 Nov 2024 19:41:17 GMT"} })
110012024-11-25T19:41:17.745ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
110022024-11-25T19:41:17.745ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
110032024-11-25T19:41:17.745ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
110042024-11-25T19:41:17.747ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110052024-11-25T19:41:17.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110062024-11-25T19:41:17.749ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110072024-11-25T19:41:17.751ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
110082024-11-25T19:41:17.751ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110092024-11-25T19:41:17.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110102024-11-25T19:41:17.915ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 18983a89-54f1-4930-a886-bbc28e7571eb file = nexus/db-queries/src/db/datastore/inventory.rs:1000
110112024-11-25T19:41:17.915ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 18983a89-54f1-4930-a886-bbc28e7571eb time_started = 2024-11-25 19:41:17.136673 UTC
110122024-11-25T19:41:17.915ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.063610189s iteration = 3 status = {"collection_id":"18983a89-54f1-4930-a886-bbc28e7571eb","time_done":"2024-11-25 19:41:17.745791 UTC","time_started":"2024-11-25 19:41:17.136673 UTC"}
110132024-11-25T19:41:17.915ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
110142024-11-25T19:41:17.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110152024-11-25T19:41:17.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110162024-11-25T19:41:17.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110172024-11-25T19:41:17.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110182024-11-25T19:41:17.918ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110192024-11-25T19:41:17.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110202024-11-25T19:41:17.920ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110212024-11-25T19:41:17.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110222024-11-25T19:41:17.922ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110232024-11-25T19:41:17.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110242024-11-25T19:41:17.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110252024-11-25T19:41:17.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110262024-11-25T19:41:17.964ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 49.064442ms iteration = 24 status = {"physical_disks_added":0}
110272024-11-25T19:41:18.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2cf8e008-8763-48c9-ab81-9fd6d7fa3a9b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110282024-11-25T19:41:18.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2cf8e008-8763-48c9-ab81-9fd6d7fa3a9b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110292024-11-25T19:41:18.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 2cf8e008-8763-48c9-ab81-9fd6d7fa3a9b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110302024-11-25T19:41:19.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a1a05777-e6df-4214-babc-c547926dcb28 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110312024-11-25T19:41:19.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a1a05777-e6df-4214-babc-c547926dcb28 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110322024-11-25T19:41:19.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a1a05777-e6df-4214-babc-c547926dcb28 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110332024-11-25T19:41:20.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8082a0db-23a8-4db3-9982-db21b1a146f1 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110342024-11-25T19:41:20.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8082a0db-23a8-4db3-9982-db21b1a146f1 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110352024-11-25T19:41:20.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8082a0db-23a8-4db3-9982-db21b1a146f1 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110362024-11-25T19:41:21.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 65116e3f-55e3-4a3b-983e-d245b194cfbe roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110372024-11-25T19:41:21.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 65116e3f-55e3-4a3b-983e-d245b194cfbe resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110382024-11-25T19:41:21.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 65116e3f-55e3-4a3b-983e-d245b194cfbe response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110392024-11-25T19:41:22.287ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 554 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = ed8e9a64-d558-4570-b43a-7bcecb0fafcc response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
110402024-11-25T19:41:22.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9c09504a-bd99-4cb8-b5fe-a814bf4eb80d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110412024-11-25T19:41:22.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9c09504a-bd99-4cb8-b5fe-a814bf4eb80d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110422024-11-25T19:41:22.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9c09504a-bd99-4cb8-b5fe-a814bf4eb80d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110432024-11-25T19:41:23.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c06dbb7f-0c34-4a05-af9e-c6411039b62e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110442024-11-25T19:41:23.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c06dbb7f-0c34-4a05-af9e-c6411039b62e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110452024-11-25T19:41:23.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c06dbb7f-0c34-4a05-af9e-c6411039b62e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110462024-11-25T19:41:24.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b7c9e78b-e712-43b4-8ac5-55a43919fe02 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110472024-11-25T19:41:24.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b7c9e78b-e712-43b4-8ac5-55a43919fe02 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110482024-11-25T19:41:24.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b7c9e78b-e712-43b4-8ac5-55a43919fe02 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110492024-11-25T19:41:25.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9d9a0be7-009e-4f03-a8b0-f0355f2c4cbb roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110502024-11-25T19:41:25.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9d9a0be7-009e-4f03-a8b0-f0355f2c4cbb resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110512024-11-25T19:41:25.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9d9a0be7-009e-4f03-a8b0-f0355f2c4cbb response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110522024-11-25T19:41:26.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c2bc624b-9e6b-4669-9728-a4bd428eca9d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110532024-11-25T19:41:26.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c2bc624b-9e6b-4669-9728-a4bd428eca9d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110542024-11-25T19:41:26.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c2bc624b-9e6b-4669-9728-a4bd428eca9d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110552024-11-25T19:41:26.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
110562024-11-25T19:41:26.850ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
110572024-11-25T19:41:26.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110582024-11-25T19:41:26.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110592024-11-25T19:41:26.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110602024-11-25T19:41:26.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110612024-11-25T19:41:26.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110622024-11-25T19:41:26.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110632024-11-25T19:41:26.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110642024-11-25T19:41:26.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110652024-11-25T19:41:26.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110662024-11-25T19:41:26.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110672024-11-25T19:41:26.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110682024-11-25T19:41:26.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
110692024-11-25T19:41:26.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110702024-11-25T19:41:26.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110712024-11-25T19:41:26.877ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
110722024-11-25T19:41:26.877ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.640853ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
110732024-11-25T19:41:26.884ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110742024-11-25T19:41:26.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110752024-11-25T19:41:26.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.813122ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110762024-11-25T19:41:27.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a9b7929d-161a-445e-9140-740781673ced roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110772024-11-25T19:41:27.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a9b7929d-161a-445e-9140-740781673ced resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110782024-11-25T19:41:27.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a9b7929d-161a-445e-9140-740781673ced response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110792024-11-25T19:41:28.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4607d2de-9ba9-4e31-ad89-14ae1908bff8 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110802024-11-25T19:41:28.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4607d2de-9ba9-4e31-ad89-14ae1908bff8 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110812024-11-25T19:41:28.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4607d2de-9ba9-4e31-ad89-14ae1908bff8 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110822024-11-25T19:41:29.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9d64a9da-b5ec-449c-967d-48b1238abf2f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110832024-11-25T19:41:29.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9d64a9da-b5ec-449c-967d-48b1238abf2f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110842024-11-25T19:41:29.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9d64a9da-b5ec-449c-967d-48b1238abf2f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110852024-11-25T19:41:30.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6b70da41-1670-4fe6-89ec-a7188c7c684a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110862024-11-25T19:41:30.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6b70da41-1670-4fe6-89ec-a7188c7c684a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110872024-11-25T19:41:30.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6b70da41-1670-4fe6-89ec-a7188c7c684a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110882024-11-25T19:41:31.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d58b899c-7444-4d38-a200-85a83c29c9c5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110892024-11-25T19:41:31.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d58b899c-7444-4d38-a200-85a83c29c9c5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110902024-11-25T19:41:31.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d58b899c-7444-4d38-a200-85a83c29c9c5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110912024-11-25T19:41:32.287ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 507 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 59acfbda-bd06-4529-aeca-d66c746260cd response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
110922024-11-25T19:41:32.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dee1387d-e0b4-4eca-b386-02bf5a800788 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110932024-11-25T19:41:32.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dee1387d-e0b4-4eca-b386-02bf5a800788 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110942024-11-25T19:41:32.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1812 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dee1387d-e0b4-4eca-b386-02bf5a800788 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110952024-11-25T19:41:33.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aad74404-1e85-4bfd-a5fc-b74e71842b86 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110962024-11-25T19:41:33.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aad74404-1e85-4bfd-a5fc-b74e71842b86 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110972024-11-25T19:41:33.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aad74404-1e85-4bfd-a5fc-b74e71842b86 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110982024-11-25T19:41:34.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b77327d1-63e3-4d38-8ca1-10cca0bd8481 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
110992024-11-25T19:41:34.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b77327d1-63e3-4d38-8ca1-10cca0bd8481 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111002024-11-25T19:41:34.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1939 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b77327d1-63e3-4d38-8ca1-10cca0bd8481 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111012024-11-25T19:41:35.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 468e4957-093b-4d60-b644-f838911632b4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111022024-11-25T19:41:35.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 468e4957-093b-4d60-b644-f838911632b4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111032024-11-25T19:41:35.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 468e4957-093b-4d60-b644-f838911632b4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111042024-11-25T19:41:36.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b045cfaf-de5c-4c8c-b2a2-e814fabfd64d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111052024-11-25T19:41:36.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b045cfaf-de5c-4c8c-b2a2-e814fabfd64d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111062024-11-25T19:41:36.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b045cfaf-de5c-4c8c-b2a2-e814fabfd64d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111072024-11-25T19:41:36.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
111082024-11-25T19:41:36.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
111092024-11-25T19:41:36.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111102024-11-25T19:41:36.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111112024-11-25T19:41:36.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111122024-11-25T19:41:36.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111132024-11-25T19:41:36.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111142024-11-25T19:41:36.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111152024-11-25T19:41:36.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111162024-11-25T19:41:36.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111172024-11-25T19:41:36.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111182024-11-25T19:41:36.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111192024-11-25T19:41:36.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111202024-11-25T19:41:36.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
111212024-11-25T19:41:36.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111222024-11-25T19:41:36.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111232024-11-25T19:41:36.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
111242024-11-25T19:41:36.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.621134ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
111252024-11-25T19:41:36.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111262024-11-25T19:41:36.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111272024-11-25T19:41:36.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.783222ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111282024-11-25T19:41:37.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = d14d5551-b5d9-44ff-9c4b-a6f73a98223c roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
111292024-11-25T19:41:37.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = d14d5551-b5d9-44ff-9c4b-a6f73a98223c resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
111302024-11-25T19:41:37.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = d14d5551-b5d9-44ff-9c4b-a6f73a98223c response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
111312024-11-25T19:41:37.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = d2ad05ce-348d-4fe3-b773-6f8146608fb3 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
111322024-11-25T19:41:37.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = d2ad05ce-348d-4fe3-b773-6f8146608fb3 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
111332024-11-25T19:41:37.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = d2ad05ce-348d-4fe3-b773-6f8146608fb3 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
111342024-11-25T19:41:37.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 69323c9a-16d8-4768-afaf-d1bee6cd2e50 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111352024-11-25T19:41:37.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 69323c9a-16d8-4768-afaf-d1bee6cd2e50 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111362024-11-25T19:41:37.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 69323c9a-16d8-4768-afaf-d1bee6cd2e50 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111372024-11-25T19:41:38.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6dd34b80-ca27-4bab-93cc-bc7686bddc83 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111382024-11-25T19:41:38.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6dd34b80-ca27-4bab-93cc-bc7686bddc83 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111392024-11-25T19:41:38.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6dd34b80-ca27-4bab-93cc-bc7686bddc83 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111402024-11-25T19:41:39.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dc87e613-33d6-432b-8f63-6ef0b13ab9d4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111412024-11-25T19:41:39.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dc87e613-33d6-432b-8f63-6ef0b13ab9d4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111422024-11-25T19:41:39.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dc87e613-33d6-432b-8f63-6ef0b13ab9d4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111432024-11-25T19:41:40.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f65e5d4c-85de-45e9-a097-b799f0854553 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111442024-11-25T19:41:40.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f65e5d4c-85de-45e9-a097-b799f0854553 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111452024-11-25T19:41:40.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f65e5d4c-85de-45e9-a097-b799f0854553 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111462024-11-25T19:41:41.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b13bf09a-7771-4354-9536-3170dbaf839c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111472024-11-25T19:41:41.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b13bf09a-7771-4354-9536-3170dbaf839c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111482024-11-25T19:41:41.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b13bf09a-7771-4354-9536-3170dbaf839c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111492024-11-25T19:41:42.288ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 916 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 7f33004d-29cf-46ee-8175-9d7060efa534 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
111502024-11-25T19:41:42.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5eb384f3-40b8-4566-84f0-cff20b072dd8 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111512024-11-25T19:41:42.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5eb384f3-40b8-4566-84f0-cff20b072dd8 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111522024-11-25T19:41:42.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5eb384f3-40b8-4566-84f0-cff20b072dd8 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111532024-11-25T19:41:43.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4f0e177e-da09-480f-ba38-770ae94b139f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111542024-11-25T19:41:43.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4f0e177e-da09-480f-ba38-770ae94b139f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111552024-11-25T19:41:43.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4f0e177e-da09-480f-ba38-770ae94b139f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111562024-11-25T19:41:44.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 776ac4b8-f6c7-410c-a8bc-275f6aa613ab roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111572024-11-25T19:41:44.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 776ac4b8-f6c7-410c-a8bc-275f6aa613ab resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111582024-11-25T19:41:44.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 776ac4b8-f6c7-410c-a8bc-275f6aa613ab response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111592024-11-25T19:41:45.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90e8cdb7-aa76-4a22-a7ca-f91b774ec66d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111602024-11-25T19:41:45.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90e8cdb7-aa76-4a22-a7ca-f91b774ec66d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111612024-11-25T19:41:45.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90e8cdb7-aa76-4a22-a7ca-f91b774ec66d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111622024-11-25T19:41:46.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 5ed91b57-7faa-4abc-acff-e85cd45859de roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
111632024-11-25T19:41:46.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 5ed91b57-7faa-4abc-acff-e85cd45859de resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
111642024-11-25T19:41:46.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 5ed91b57-7faa-4abc-acff-e85cd45859de response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
111652024-11-25T19:41:46.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 61678a42-ef93-405c-ac15-a54c6964cf22 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111662024-11-25T19:41:46.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 61678a42-ef93-405c-ac15-a54c6964cf22 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111672024-11-25T19:41:46.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 61678a42-ef93-405c-ac15-a54c6964cf22 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
111682024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
111692024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
111702024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
111712024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
111722024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
111732024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
111742024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
111752024-11-25T19:41:46.851ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
111762024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
111772024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
111782024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111792024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
111802024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111812024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111822024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
111832024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
111842024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
111852024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111862024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
111872024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111882024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
111892024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111902024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
111912024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
111922024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
111932024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
111942024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
111952024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
111962024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
111972024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
111982024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111992024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
112002024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112012024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
112022024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112032024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
112042024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
112052024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
112062024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112072024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112082024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
112092024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112102024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112112024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
112122024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112132024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
112142024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
112152024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112162024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
112172024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112182024-11-25T19:41:46.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112192024-11-25T19:41:46.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1732, tv_nsec: 397688069 } })
112202024-11-25T19:41:46.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1732, tv_nsec: 397757400 } })
112212024-11-25T19:41:46.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
112222024-11-25T19:41:46.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
112232024-11-25T19:41:46.855ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.880946ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
112242024-11-25T19:41:46.857ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112252024-11-25T19:41:46.858ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112262024-11-25T19:41:46.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
112272024-11-25T19:41:46.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
112282024-11-25T19:41:46.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
112292024-11-25T19:41:46.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
112302024-11-25T19:41:46.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112312024-11-25T19:41:46.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112322024-11-25T19:41:46.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112332024-11-25T19:41:46.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112342024-11-25T19:41:46.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112352024-11-25T19:41:46.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
112362024-11-25T19:41:46.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112372024-11-25T19:41:46.889ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 38.048506ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
112382024-11-25T19:41:46.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112392024-11-25T19:41:46.890ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112402024-11-25T19:41:46.892ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.006585ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
112412024-11-25T19:41:46.892ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1732, tv_nsec: 435814847 } })
112422024-11-25T19:41:46.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112432024-11-25T19:41:46.892ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
112442024-11-25T19:41:46.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
112452024-11-25T19:41:46.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112462024-11-25T19:41:46.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112472024-11-25T19:41:46.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112482024-11-25T19:41:46.894ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112492024-11-25T19:41:46.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
112502024-11-25T19:41:46.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112512024-11-25T19:41:46.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
112522024-11-25T19:41:46.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112532024-11-25T19:41:46.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112542024-11-25T19:41:46.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112552024-11-25T19:41:46.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112562024-11-25T19:41:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112572024-11-25T19:41:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112582024-11-25T19:41:46.900ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
112592024-11-25T19:41:46.900ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112602024-11-25T19:41:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
112612024-11-25T19:41:46.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112622024-11-25T19:41:46.900ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "378e25a9-1352-4e32-b858-7b101e67b961", "content-length": "26", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
112632024-11-25T19:41:46.900ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112642024-11-25T19:41:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112652024-11-25T19:41:46.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112662024-11-25T19:41:46.901ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112672024-11-25T19:41:46.901ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
112682024-11-25T19:41:46.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112692024-11-25T19:41:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112702024-11-25T19:41:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112712024-11-25T19:41:46.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112722024-11-25T19:41:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
112732024-11-25T19:41:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112742024-11-25T19:41:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
112752024-11-25T19:41:46.902ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 51.431209ms iteration = 22 status = 0
112762024-11-25T19:41:46.902ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
112772024-11-25T19:41:46.902ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 51.541431ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
112782024-11-25T19:41:46.902ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
112792024-11-25T19:41:46.902ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
112802024-11-25T19:41:46.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
112812024-11-25T19:41:46.904ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
112822024-11-25T19:41:46.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112832024-11-25T19:41:46.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112842024-11-25T19:41:46.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112852024-11-25T19:41:46.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112862024-11-25T19:41:46.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 53.398608ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
112872024-11-25T19:41:46.912ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
112882024-11-25T19:41:46.912ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112892024-11-25T19:41:46.912ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ef89740-30b5-44db-8f77-ca2cde66e38d", "content-length": "26", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
112902024-11-25T19:41:46.912ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112912024-11-25T19:41:46.914ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
112922024-11-25T19:41:46.939ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.808153ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
112932024-11-25T19:41:46.939ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112942024-11-25T19:41:46.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112952024-11-25T19:41:46.939ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.741681ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112962024-11-25T19:41:46.939ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112972024-11-25T19:41:46.939ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
112982024-11-25T19:41:46.939ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112992024-11-25T19:41:46.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113002024-11-25T19:41:46.940ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
113012024-11-25T19:41:46.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
113022024-11-25T19:41:46.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
113032024-11-25T19:41:46.942ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113042024-11-25T19:41:46.942ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
113052024-11-25T19:41:46.942ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113062024-11-25T19:41:46.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113072024-11-25T19:41:46.942ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113082024-11-25T19:41:46.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113092024-11-25T19:41:46.945ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
113102024-11-25T19:41:46.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113112024-11-25T19:41:46.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113122024-11-25T19:41:46.958ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
113132024-11-25T19:41:46.958ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 107.120661ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
113142024-11-25T19:41:46.979ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 128.43461ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
113152024-11-25T19:41:46.980ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113162024-11-25T19:41:46.980ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
113172024-11-25T19:41:46.980ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 129.446819ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
113182024-11-25T19:41:46.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113192024-11-25T19:41:46.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113202024-11-25T19:41:47.004ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
113212024-11-25T19:41:47.004ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
113222024-11-25T19:41:47.004ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca2f6add-0acd-4a28-99e8-cfe8fd8b9aa5", "content-length": "26", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
113232024-11-25T19:41:47.004ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113242024-11-25T19:41:47.006ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
113252024-11-25T19:41:47.008ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
113262024-11-25T19:41:47.008ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f43eb06-d528-4124-b878-69746d91ada3", "content-length": "1", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
113272024-11-25T19:41:47.010ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
113282024-11-25T19:41:47.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
113292024-11-25T19:41:47.012ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 161.07338ms iteration = 22 status = null
113302024-11-25T19:41:47.013ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 162.726933ms iteration = 22 status = {}
113312024-11-25T19:41:47.049ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 197.881803ms iteration = 25 status = {"physical_disks_added":0}
113322024-11-25T19:41:47.076ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
113332024-11-25T19:41:47.076ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
113342024-11-25T19:41:47.076ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "adb94de2-83b5-4d10-aa9b-1d74bc7293e0", "content-length": "372", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
113352024-11-25T19:41:47.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113362024-11-25T19:41:47.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113372024-11-25T19:41:47.087ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113382024-11-25T19:41:47.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113392024-11-25T19:41:47.089ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113402024-11-25T19:41:47.093ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
113412024-11-25T19:41:47.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113422024-11-25T19:41:47.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113432024-11-25T19:41:47.094ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113442024-11-25T19:41:47.094ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
113452024-11-25T19:41:47.094ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
113462024-11-25T19:41:47.094ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a692c206-e89a-40b4-b125-5f655caea273", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
113472024-11-25T19:41:47.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113482024-11-25T19:41:47.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113492024-11-25T19:41:47.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
113502024-11-25T19:41:47.096ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113512024-11-25T19:41:47.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113522024-11-25T19:41:47.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113532024-11-25T19:41:47.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113542024-11-25T19:41:47.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113552024-11-25T19:41:47.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113562024-11-25T19:41:47.104ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
113572024-11-25T19:41:47.105ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
113582024-11-25T19:41:47.105ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e19b3e09-e9c0-431e-9655-47f8d5cac67a", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
113592024-11-25T19:41:47.107ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 256.520633ms iteration = 22 status = {}
113602024-11-25T19:41:47.182ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
113612024-11-25T19:41:47.182ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f36de72c-8abb-4959-a79e-43ae8b97baf6", "content-length": "691", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
113622024-11-25T19:41:47.183ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
113632024-11-25T19:41:47.183ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
113642024-11-25T19:41:47.183ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
113652024-11-25T19:41:47.184ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 332.916212ms iteration = 22 status = {}
113662024-11-25T19:41:47.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113672024-11-25T19:41:47.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113682024-11-25T19:41:47.187ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
113692024-11-25T19:41:47.187ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113702024-11-25T19:41:47.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113712024-11-25T19:41:47.197ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
113722024-11-25T19:41:47.198ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "57651930-ff7e-48a8-b1b1-8dd34306ebbe", "content-length": "134", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
113732024-11-25T19:41:47.198ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
113742024-11-25T19:41:47.198ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
113752024-11-25T19:41:47.198ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
113762024-11-25T19:41:47.198ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
113772024-11-25T19:41:47.198ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113782024-11-25T19:41:47.198ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113792024-11-25T19:41:47.198ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113802024-11-25T19:41:47.198ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
113812024-11-25T19:41:47.198ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113822024-11-25T19:41:47.198ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
113832024-11-25T19:41:47.199ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
113842024-11-25T19:41:47.199ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113852024-11-25T19:41:47.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113862024-11-25T19:41:47.205ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
113872024-11-25T19:41:47.205ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ad8eb95-6eb8-4684-8e16-d10b873adf85", "content-length": "2", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
113882024-11-25T19:41:47.205ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
113892024-11-25T19:41:47.205ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "62e6607f-bf8a-48d5-9ff1-819b6df9fa26", "content-length": "51", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
113902024-11-25T19:41:47.205ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
113912024-11-25T19:41:47.205ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
113922024-11-25T19:41:47.307ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c6547530-ec8e-424a-b935-15fb65b71c76", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
113932024-11-25T19:41:47.307ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
113942024-11-25T19:41:47.307ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
113952024-11-25T19:41:47.307ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f109434-6fa5-49e2-a0e7-5487daed4b64", "content-length": "682", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
113962024-11-25T19:41:47.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113972024-11-25T19:41:47.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113982024-11-25T19:41:47.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113992024-11-25T19:41:47.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114002024-11-25T19:41:47.316ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114012024-11-25T19:41:47.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114022024-11-25T19:41:47.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114032024-11-25T19:41:47.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114042024-11-25T19:41:47.326ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 475.01908ms iteration = 22 status = {}
114052024-11-25T19:41:47.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fc02bf65-1ac1-460e-af1c-97b306f519c4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114062024-11-25T19:41:47.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fc02bf65-1ac1-460e-af1c-97b306f519c4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114072024-11-25T19:41:47.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fc02bf65-1ac1-460e-af1c-97b306f519c4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114082024-11-25T19:41:48.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8c6b9af0-3c84-4b36-a175-d026050cb917 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114092024-11-25T19:41:48.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8c6b9af0-3c84-4b36-a175-d026050cb917 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114102024-11-25T19:41:48.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8c6b9af0-3c84-4b36-a175-d026050cb917 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114112024-11-25T19:41:49.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1820e381-5ae6-4b3e-b791-7de40561e21d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114122024-11-25T19:41:49.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1820e381-5ae6-4b3e-b791-7de40561e21d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114132024-11-25T19:41:49.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1820e381-5ae6-4b3e-b791-7de40561e21d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114142024-11-25T19:41:50.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 262920ff-bc03-4cc9-941e-b457c64727e7 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114152024-11-25T19:41:50.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 262920ff-bc03-4cc9-941e-b457c64727e7 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114162024-11-25T19:41:50.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2682 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 262920ff-bc03-4cc9-941e-b457c64727e7 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114172024-11-25T19:41:51.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 55df2c9e-390c-42ff-b27f-ba4af443d319 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114182024-11-25T19:41:51.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 55df2c9e-390c-42ff-b27f-ba4af443d319 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114192024-11-25T19:41:51.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 55df2c9e-390c-42ff-b27f-ba4af443d319 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114202024-11-25T19:41:52.287ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 564 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 792aeda6-39d5-4ce5-9780-6bfd1b5d636c response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
114212024-11-25T19:41:52.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a6800a2b-ee93-4a01-8ff7-e096e9a09abe roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114222024-11-25T19:41:52.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a6800a2b-ee93-4a01-8ff7-e096e9a09abe resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114232024-11-25T19:41:52.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a6800a2b-ee93-4a01-8ff7-e096e9a09abe response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114242024-11-25T19:41:54.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b42e2698-a4a0-4e29-9026-c975e02b98da roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114252024-11-25T19:41:54.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b42e2698-a4a0-4e29-9026-c975e02b98da resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114262024-11-25T19:41:54.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b42e2698-a4a0-4e29-9026-c975e02b98da response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114272024-11-25T19:41:55.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a4b0a342-dacd-47f8-b845-cc10815455f5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114282024-11-25T19:41:55.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a4b0a342-dacd-47f8-b845-cc10815455f5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114292024-11-25T19:41:55.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a4b0a342-dacd-47f8-b845-cc10815455f5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114302024-11-25T19:41:56.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4dc55d92-94b9-41e0-9b8f-5de5e713ef00 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114312024-11-25T19:41:56.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4dc55d92-94b9-41e0-9b8f-5de5e713ef00 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114322024-11-25T19:41:56.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1812 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4dc55d92-94b9-41e0-9b8f-5de5e713ef00 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114332024-11-25T19:41:56.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
114342024-11-25T19:41:56.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114352024-11-25T19:41:56.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
114362024-11-25T19:41:56.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114372024-11-25T19:41:56.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114382024-11-25T19:41:56.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114392024-11-25T19:41:56.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114402024-11-25T19:41:56.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114412024-11-25T19:41:56.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114422024-11-25T19:41:56.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114432024-11-25T19:41:56.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114442024-11-25T19:41:56.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114452024-11-25T19:41:56.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114462024-11-25T19:41:56.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
114472024-11-25T19:41:56.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114482024-11-25T19:41:56.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114492024-11-25T19:41:56.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
114502024-11-25T19:41:56.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.046122ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
114512024-11-25T19:41:56.886ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114522024-11-25T19:41:56.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114532024-11-25T19:41:56.916ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.581907ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
114542024-11-25T19:41:57.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0f7434a7-5f43-4c67-a029-02d27c89d75b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114552024-11-25T19:41:57.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0f7434a7-5f43-4c67-a029-02d27c89d75b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114562024-11-25T19:41:57.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0f7434a7-5f43-4c67-a029-02d27c89d75b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114572024-11-25T19:41:58.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bb599bab-0ece-46c9-b0fb-cf608ff95fd5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114582024-11-25T19:41:58.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bb599bab-0ece-46c9-b0fb-cf608ff95fd5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114592024-11-25T19:41:58.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bb599bab-0ece-46c9-b0fb-cf608ff95fd5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114602024-11-25T19:41:59.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c0d3eed0-7a9d-4fbc-9467-e72fbf6b4595 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114612024-11-25T19:41:59.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c0d3eed0-7a9d-4fbc-9467-e72fbf6b4595 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114622024-11-25T19:41:59.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c0d3eed0-7a9d-4fbc-9467-e72fbf6b4595 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114632024-11-25T19:42:00.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d7ea4fad-31e8-4a19-8d53-3fb90262e162 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114642024-11-25T19:42:00.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d7ea4fad-31e8-4a19-8d53-3fb90262e162 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114652024-11-25T19:42:00.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d7ea4fad-31e8-4a19-8d53-3fb90262e162 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114662024-11-25T19:42:01.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3f086509-fec7-45f4-85bb-97a2f625e81c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114672024-11-25T19:42:01.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3f086509-fec7-45f4-85bb-97a2f625e81c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114682024-11-25T19:42:01.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3f086509-fec7-45f4-85bb-97a2f625e81c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114692024-11-25T19:42:02.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 64310546-5d86-45d7-b660-bdbae2bcfede roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114702024-11-25T19:42:02.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 64310546-5d86-45d7-b660-bdbae2bcfede resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114712024-11-25T19:42:02.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 64310546-5d86-45d7-b660-bdbae2bcfede response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114722024-11-25T19:42:02.287ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 889 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 7f1e0648-d3c7-4026-9fc0-f3aa3f09728e response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
114732024-11-25T19:42:03.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 688807b6-d5e9-453a-a696-a21ad7184207 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114742024-11-25T19:42:03.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 688807b6-d5e9-453a-a696-a21ad7184207 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114752024-11-25T19:42:03.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 688807b6-d5e9-453a-a696-a21ad7184207 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114762024-11-25T19:42:04.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d81d03f3-f258-424b-a7e6-71de4aa3d916 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114772024-11-25T19:42:04.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d81d03f3-f258-424b-a7e6-71de4aa3d916 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114782024-11-25T19:42:04.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d81d03f3-f258-424b-a7e6-71de4aa3d916 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114792024-11-25T19:42:05.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e30f8691-44a1-400e-ad56-5c2f9277be4e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114802024-11-25T19:42:05.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e30f8691-44a1-400e-ad56-5c2f9277be4e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114812024-11-25T19:42:05.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e30f8691-44a1-400e-ad56-5c2f9277be4e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114822024-11-25T19:42:06.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 291a27f0-6bb2-47a0-8b7e-c61c9714754b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114832024-11-25T19:42:06.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 291a27f0-6bb2-47a0-8b7e-c61c9714754b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114842024-11-25T19:42:06.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 291a27f0-6bb2-47a0-8b7e-c61c9714754b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
114852024-11-25T19:42:06.850ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
114862024-11-25T19:42:06.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
114872024-11-25T19:42:06.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114882024-11-25T19:42:06.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114892024-11-25T19:42:06.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114902024-11-25T19:42:06.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114912024-11-25T19:42:06.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114922024-11-25T19:42:06.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114932024-11-25T19:42:06.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114942024-11-25T19:42:06.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114952024-11-25T19:42:06.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114962024-11-25T19:42:06.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114972024-11-25T19:42:06.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114982024-11-25T19:42:06.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
114992024-11-25T19:42:06.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115002024-11-25T19:42:06.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115012024-11-25T19:42:06.874ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
115022024-11-25T19:42:06.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.039472ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
115032024-11-25T19:42:06.878ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115042024-11-25T19:42:06.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115052024-11-25T19:42:06.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.382927ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
115062024-11-25T19:42:07.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0ca483d2-1b70-47ff-96dd-99824b031c48 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115072024-11-25T19:42:07.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0ca483d2-1b70-47ff-96dd-99824b031c48 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115082024-11-25T19:42:07.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1722 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0ca483d2-1b70-47ff-96dd-99824b031c48 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115092024-11-25T19:42:07.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 649003a5-7e2b-43d5-adb6-c83263153eab roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
115102024-11-25T19:42:07.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 649003a5-7e2b-43d5-adb6-c83263153eab resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
115112024-11-25T19:42:07.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 649003a5-7e2b-43d5-adb6-c83263153eab response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
115122024-11-25T19:42:07.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 6352875d-fc26-42e5-b2c4-3391a9e8981e roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
115132024-11-25T19:42:07.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 6352875d-fc26-42e5-b2c4-3391a9e8981e resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
115142024-11-25T19:42:07.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 6352875d-fc26-42e5-b2c4-3391a9e8981e response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
115152024-11-25T19:42:08.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 02999cf1-4bae-4049-92d3-3386017cc7bd roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115162024-11-25T19:42:08.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 02999cf1-4bae-4049-92d3-3386017cc7bd resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115172024-11-25T19:42:08.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 02999cf1-4bae-4049-92d3-3386017cc7bd response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115182024-11-25T19:42:09.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 24632eb7-9de9-4e63-85f9-c608b696bbf6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115192024-11-25T19:42:09.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 24632eb7-9de9-4e63-85f9-c608b696bbf6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115202024-11-25T19:42:09.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 24632eb7-9de9-4e63-85f9-c608b696bbf6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115212024-11-25T19:42:10.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f1a10661-d608-465b-8b52-b52c090e7a9c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115222024-11-25T19:42:10.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f1a10661-d608-465b-8b52-b52c090e7a9c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115232024-11-25T19:42:10.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f1a10661-d608-465b-8b52-b52c090e7a9c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115242024-11-25T19:42:11.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6a50597c-5585-45c1-b91e-11c637c4d9bd roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115252024-11-25T19:42:11.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6a50597c-5585-45c1-b91e-11c637c4d9bd resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115262024-11-25T19:42:11.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6a50597c-5585-45c1-b91e-11c637c4d9bd response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115272024-11-25T19:42:12.288ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 481 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 212379c6-7553-47ae-a6b8-3ac084a5d5f0 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
115282024-11-25T19:42:12.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a82db93d-7e65-4e44-9045-dd40fb8b9776 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115292024-11-25T19:42:12.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a82db93d-7e65-4e44-9045-dd40fb8b9776 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115302024-11-25T19:42:12.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a82db93d-7e65-4e44-9045-dd40fb8b9776 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115312024-11-25T19:42:13.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 59927e04-4efe-4741-966f-8a4707081595 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115322024-11-25T19:42:13.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 59927e04-4efe-4741-966f-8a4707081595 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115332024-11-25T19:42:13.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 59927e04-4efe-4741-966f-8a4707081595 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115342024-11-25T19:42:14.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3aa53684-5eb1-4926-862f-1fdb51fb2d11 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115352024-11-25T19:42:14.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3aa53684-5eb1-4926-862f-1fdb51fb2d11 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115362024-11-25T19:42:14.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3aa53684-5eb1-4926-862f-1fdb51fb2d11 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115372024-11-25T19:42:15.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c575384a-ffa2-4c99-ad11-fad2b71c1c46 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115382024-11-25T19:42:15.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c575384a-ffa2-4c99-ad11-fad2b71c1c46 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115392024-11-25T19:42:15.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c575384a-ffa2-4c99-ad11-fad2b71c1c46 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115402024-11-25T19:42:16.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a197f48f-cf3d-4ef4-98ea-8985a7ac2210 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115412024-11-25T19:42:16.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a197f48f-cf3d-4ef4-98ea-8985a7ac2210 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115422024-11-25T19:42:16.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a197f48f-cf3d-4ef4-98ea-8985a7ac2210 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
115432024-11-25T19:42:16.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 2d9c30ec-c66f-45f0-84c1-b2034e690f25 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
115442024-11-25T19:42:16.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 2d9c30ec-c66f-45f0-84c1-b2034e690f25 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
115452024-11-25T19:42:16.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 2d9c30ec-c66f-45f0-84c1-b2034e690f25 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
115462024-11-25T19:42:16.850ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
115472024-11-25T19:42:16.850ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
115482024-11-25T19:42:16.850ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
115492024-11-25T19:42:16.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115502024-11-25T19:42:16.850ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
115512024-11-25T19:42:16.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115522024-11-25T19:42:16.850ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
115532024-11-25T19:42:16.850ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
115542024-11-25T19:42:16.850ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
115552024-11-25T19:42:16.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
115562024-11-25T19:42:16.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115572024-11-25T19:42:16.850ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
115582024-11-25T19:42:16.850ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
115592024-11-25T19:42:16.850ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
115602024-11-25T19:42:16.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
115612024-11-25T19:42:16.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115622024-11-25T19:42:16.850ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
115632024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
115642024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
115652024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
115662024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
115672024-11-25T19:42:16.851ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:32:16.850972885 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
115682024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
115692024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
115702024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
115712024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
115722024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
115732024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
115742024-11-25T19:42:16.851ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
115752024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
115762024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
115772024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
115782024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
115792024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115802024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
115812024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
115822024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
115832024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
115842024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
115852024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115862024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
115872024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115882024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
115892024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
115902024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
115912024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
115922024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
115932024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
115942024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
115952024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
115962024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
115972024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115982024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
115992024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
116002024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
116012024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
116022024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
116032024-11-25T19:42:16.851ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
116042024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.2\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
116052024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
116062024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
116072024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
116082024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
116092024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116102024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116112024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116122024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
116132024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116142024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
116152024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
116162024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
116172024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116182024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
116192024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
116202024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
116212024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
116222024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
116232024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116242024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116252024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
116262024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
116272024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
116282024-11-25T19:42:16.851ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1762, tv_nsec: 395041067 } })
116292024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
116302024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
116312024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
116322024-11-25T19:42:16.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
116332024-11-25T19:42:16.851ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1762, tv_nsec: 395111438 } })
116342024-11-25T19:42:16.852ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
116352024-11-25T19:42:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.247904ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
116362024-11-25T19:42:16.852ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
116372024-11-25T19:42:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.172343ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
116382024-11-25T19:42:16.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116392024-11-25T19:42:16.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
116402024-11-25T19:42:16.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
116412024-11-25T19:42:16.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1762, tv_nsec: 397986405 } })
116422024-11-25T19:42:16.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116432024-11-25T19:42:16.854ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.601851ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
116442024-11-25T19:42:16.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
116452024-11-25T19:42:16.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116462024-11-25T19:42:16.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116472024-11-25T19:42:16.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116482024-11-25T19:42:16.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116492024-11-25T19:42:16.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116502024-11-25T19:42:16.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
116512024-11-25T19:42:16.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116522024-11-25T19:42:16.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116532024-11-25T19:42:16.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116542024-11-25T19:42:16.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116552024-11-25T19:42:16.860ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:32:16.850972885 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
116562024-11-25T19:42:16.860ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.733871ms iteration = 12 status = {"expiration":"2024-11-25T19:32:16.850972885Z","pruned":[]}
116572024-11-25T19:42:16.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116582024-11-25T19:42:16.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116592024-11-25T19:42:16.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1762, tv_nsec: 404467702 } })
116602024-11-25T19:42:16.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
116612024-11-25T19:42:16.861ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116622024-11-25T19:42:16.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
116632024-11-25T19:42:16.864ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
116642024-11-25T19:42:16.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
116652024-11-25T19:42:16.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116662024-11-25T19:42:16.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
116672024-11-25T19:42:16.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116682024-11-25T19:42:16.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116692024-11-25T19:42:16.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
116702024-11-25T19:42:16.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
116712024-11-25T19:42:16.871ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.8684ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
116722024-11-25T19:42:16.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116732024-11-25T19:42:16.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116742024-11-25T19:42:16.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116752024-11-25T19:42:16.876ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116762024-11-25T19:42:16.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116772024-11-25T19:42:16.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
116782024-11-25T19:42:16.882ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1762, tv_nsec: 425600796 } })
116792024-11-25T19:42:16.882ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
116802024-11-25T19:42:16.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116812024-11-25T19:42:16.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116822024-11-25T19:42:16.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
116832024-11-25T19:42:16.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116842024-11-25T19:42:16.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116852024-11-25T19:42:16.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
116862024-11-25T19:42:16.888ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116872024-11-25T19:42:16.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116882024-11-25T19:42:16.890ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116892024-11-25T19:42:16.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116902024-11-25T19:42:16.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116912024-11-25T19:42:16.892ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
116922024-11-25T19:42:16.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116932024-11-25T19:42:16.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
116942024-11-25T19:42:16.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.045582ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
116952024-11-25T19:42:16.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116962024-11-25T19:42:16.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116972024-11-25T19:42:16.907ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
116982024-11-25T19:42:16.907ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
116992024-11-25T19:42:16.907ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 56.312875ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
117002024-11-25T19:42:16.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117012024-11-25T19:42:16.910ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
117022024-11-25T19:42:16.910ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.035477ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
117032024-11-25T19:42:16.911ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117042024-11-25T19:42:16.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
117052024-11-25T19:42:16.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117062024-11-25T19:42:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117072024-11-25T19:42:16.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
117082024-11-25T19:42:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
117092024-11-25T19:42:16.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.651359ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
117102024-11-25T19:42:16.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.888494ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117112024-11-25T19:42:16.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
117122024-11-25T19:42:16.914ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117132024-11-25T19:42:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117142024-11-25T19:42:16.915ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117152024-11-25T19:42:16.915ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
117162024-11-25T19:42:16.915ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
117172024-11-25T19:42:16.915ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 64.617687ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
117182024-11-25T19:42:16.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
117192024-11-25T19:42:16.918ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
117202024-11-25T19:42:16.918ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
117212024-11-25T19:42:16.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
117222024-11-25T19:42:16.918ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
117232024-11-25T19:42:16.918ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
117242024-11-25T19:42:16.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
117252024-11-25T19:42:16.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117262024-11-25T19:42:16.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
117272024-11-25T19:42:16.919ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117282024-11-25T19:42:16.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117292024-11-25T19:42:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
117302024-11-25T19:42:16.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117312024-11-25T19:42:16.923ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117322024-11-25T19:42:16.924ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
117332024-11-25T19:42:16.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
117342024-11-25T19:42:16.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
117352024-11-25T19:42:16.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
117362024-11-25T19:42:16.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
117372024-11-25T19:42:16.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
117382024-11-25T19:42:16.927ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117392024-11-25T19:42:16.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117402024-11-25T19:42:16.928ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
117412024-11-25T19:42:16.929ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
117422024-11-25T19:42:16.929ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117432024-11-25T19:42:16.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117442024-11-25T19:42:16.937ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117452024-11-25T19:42:16.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117462024-11-25T19:42:16.942ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117472024-11-25T19:42:16.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117482024-11-25T19:42:16.945ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117492024-11-25T19:42:16.946ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 95.502154ms iteration = 26 status = {"physical_disks_added":0}
117502024-11-25T19:42:16.948ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
117512024-11-25T19:42:16.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
117522024-11-25T19:42:16.948ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.748057ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
117532024-11-25T19:42:16.949ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
117542024-11-25T19:42:16.949ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117552024-11-25T19:42:16.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117562024-11-25T19:42:16.952ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 101.251596ms iteration = 23 status = 0
117572024-11-25T19:42:16.960ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 109.548899ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
117582024-11-25T19:42:16.967ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
117592024-11-25T19:42:16.967ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
117602024-11-25T19:42:16.967ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
117612024-11-25T19:42:16.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117622024-11-25T19:42:16.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117632024-11-25T19:42:16.968ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
117642024-11-25T19:42:16.968ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
117652024-11-25T19:42:16.968ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117662024-11-25T19:42:16.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117672024-11-25T19:42:16.969ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117682024-11-25T19:42:16.971ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117692024-11-25T19:42:16.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117702024-11-25T19:42:16.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
117712024-11-25T19:42:16.971ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117722024-11-25T19:42:16.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117732024-11-25T19:42:16.972ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117742024-11-25T19:42:16.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
117752024-11-25T19:42:16.974ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117762024-11-25T19:42:16.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117772024-11-25T19:42:16.975ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
117782024-11-25T19:42:16.975ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 124.077373ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
117792024-11-25T19:42:16.976ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
117802024-11-25T19:42:16.976ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
117812024-11-25T19:42:16.976ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
117822024-11-25T19:42:16.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
117832024-11-25T19:42:16.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
117842024-11-25T19:42:16.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
117852024-11-25T19:42:16.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117862024-11-25T19:42:16.982ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
117872024-11-25T19:42:16.982ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
117882024-11-25T19:42:16.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
117892024-11-25T19:42:16.985ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
117902024-11-25T19:42:16.985ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
117912024-11-25T19:42:16.985ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
117922024-11-25T19:42:16.985ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 134.57592ms iteration = 12 status = {"generation":2}
117932024-11-25T19:42:16.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117942024-11-25T19:42:16.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117952024-11-25T19:42:17.004ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
117962024-11-25T19:42:17.005ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
117972024-11-25T19:42:17.005ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 153.815857ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
117982024-11-25T19:42:17.005ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 154.827307ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
117992024-11-25T19:42:17.006ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
118002024-11-25T19:42:17.006ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
118012024-11-25T19:42:17.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118022024-11-25T19:42:17.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118032024-11-25T19:42:17.008ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118042024-11-25T19:42:17.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
118052024-11-25T19:42:17.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118062024-11-25T19:42:17.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118072024-11-25T19:42:17.013ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
118082024-11-25T19:42:17.013ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
118092024-11-25T19:42:17.013ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
118102024-11-25T19:42:17.013ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 162.64754ms iteration = 12 status = {"generation":1}
118112024-11-25T19:42:17.013ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
118122024-11-25T19:42:17.013ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 162.639031ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
118132024-11-25T19:42:17.015ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
118142024-11-25T19:42:17.015ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 164.282083ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
118152024-11-25T19:42:17.020ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
118162024-11-25T19:42:17.029ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
118172024-11-25T19:42:17.029ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118182024-11-25T19:42:17.029ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5193d61b-03dc-42ff-ab21-f6a3bc2eaf17", "content-length": "26", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
118192024-11-25T19:42:17.029ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118202024-11-25T19:42:17.031ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118212024-11-25T19:42:17.080ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118222024-11-25T19:42:17.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118232024-11-25T19:42:17.165ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
118242024-11-25T19:42:17.165ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
118252024-11-25T19:42:17.165ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ffd876d-d7b1-4ef5-94b7-834da7409c96", "content-length": "372", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
118262024-11-25T19:42:17.165ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118272024-11-25T19:42:17.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118282024-11-25T19:42:17.194ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
118292024-11-25T19:42:17.194ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a19584a9-1549-468c-b227-6dc253015ea8", "content-length": "1", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
118302024-11-25T19:42:17.196ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
118312024-11-25T19:42:17.196ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
118322024-11-25T19:42:17.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
118332024-11-25T19:42:17.199ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 348.055109ms iteration = 23 status = null
118342024-11-25T19:42:17.203ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
118352024-11-25T19:42:17.204ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118362024-11-25T19:42:17.206ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
118372024-11-25T19:42:17.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118382024-11-25T19:42:17.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118392024-11-25T19:42:17.207ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118402024-11-25T19:42:17.209ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
118412024-11-25T19:42:17.209ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118422024-11-25T19:42:17.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118432024-11-25T19:42:17.213ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
118442024-11-25T19:42:17.213ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
118452024-11-25T19:42:17.214ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "19dc4625-1042-4af8-9d51-053e8ee5e437", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
118462024-11-25T19:42:17.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118472024-11-25T19:42:17.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118482024-11-25T19:42:17.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118492024-11-25T19:42:17.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118502024-11-25T19:42:17.218ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118512024-11-25T19:42:17.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118522024-11-25T19:42:17.222ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
118532024-11-25T19:42:17.222ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
118542024-11-25T19:42:17.223ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "50b4c32c-a332-42b1-9bcc-3ce8969f664a", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
118552024-11-25T19:42:17.225ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 374.64961ms iteration = 23 status = {}
118562024-11-25T19:42:17.232ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
118572024-11-25T19:42:17.232ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118582024-11-25T19:42:17.232ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "885575c8-d9de-43eb-bf6a-1cc36267c708", "content-length": "26", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
118592024-11-25T19:42:17.232ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118602024-11-25T19:42:17.235ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118612024-11-25T19:42:17.236ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
118622024-11-25T19:42:17.236ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118632024-11-25T19:42:17.237ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb6896f9-01f7-453b-9cdd-498cfada83da", "content-length": "26", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
118642024-11-25T19:42:17.237ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118652024-11-25T19:42:17.239ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
118662024-11-25T19:42:17.376ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
118672024-11-25T19:42:17.377ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c52f5107-140f-4de6-95f5-f624d9ca746e", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
118682024-11-25T19:42:17.377ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
118692024-11-25T19:42:17.378ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c6e2026e-099f-45eb-86de-9cacc8df3b3b", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
118702024-11-25T19:42:17.378ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
118712024-11-25T19:42:17.380ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
118722024-11-25T19:42:17.380ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 528.863126ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
118732024-11-25T19:42:17.390ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 539.608727ms iteration = 23 status = {}
118742024-11-25T19:42:17.418ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
118752024-11-25T19:42:17.419ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c5bfbe0-cd59-45a0-8d18-3e63ea272c16", "content-length": "691", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
118762024-11-25T19:42:17.419ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
118772024-11-25T19:42:17.419ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
118782024-11-25T19:42:17.419ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
118792024-11-25T19:42:17.420ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 569.844469ms iteration = 23 status = {}
118802024-11-25T19:42:17.422ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
118812024-11-25T19:42:17.423ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "2349853d-70aa-458a-a7ce-3ca3cb534c97", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
118822024-11-25T19:42:17.423ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
118832024-11-25T19:42:17.424ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2c4e3853-c8ec-4e36-85f1-713b4c23e783", "date": "Mon, 25 Nov 2024 19:42:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
118842024-11-25T19:42:17.424ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
118852024-11-25T19:42:17.426ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "188bd565-bcb3-46f7-8687-df548ec93e78", "date": "Mon, 25 Nov 2024 19:42:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
118862024-11-25T19:42:17.426ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
118872024-11-25T19:42:17.428ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
118882024-11-25T19:42:17.428ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 577.112892ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
118892024-11-25T19:42:17.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118902024-11-25T19:42:17.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118912024-11-25T19:42:17.491ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
118922024-11-25T19:42:17.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118932024-11-25T19:42:17.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118942024-11-25T19:42:17.502ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
118952024-11-25T19:42:17.502ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "05979f35-8374-49b7-943e-6d4a0ce1d70d", "content-length": "134", "date": "Mon, 25 Nov 2024 19:42:17 GMT"} })
118962024-11-25T19:42:17.502ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
118972024-11-25T19:42:17.502ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
118982024-11-25T19:42:17.502ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
118992024-11-25T19:42:17.502ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
119002024-11-25T19:42:17.502ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119012024-11-25T19:42:17.502ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119022024-11-25T19:42:17.502ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119032024-11-25T19:42:17.502ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119042024-11-25T19:42:17.503ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119052024-11-25T19:42:17.503ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119062024-11-25T19:42:17.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 53e13d16-63ee-4b1a-9baf-9f49954f5987 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119072024-11-25T19:42:17.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 53e13d16-63ee-4b1a-9baf-9f49954f5987 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119082024-11-25T19:42:17.503ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
119092024-11-25T19:42:17.503ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119102024-11-25T19:42:17.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119112024-11-25T19:42:17.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 53e13d16-63ee-4b1a-9baf-9f49954f5987 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119122024-11-25T19:42:17.505ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
119132024-11-25T19:42:17.505ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d9c6a42-2059-4215-bdef-b09fc83ddd32", "content-length": "2", "date": "Mon, 25 Nov 2024 19:42:17 GMT"} })
119142024-11-25T19:42:17.505ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
119152024-11-25T19:42:17.506ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe7b71f4-9125-4ac7-9e2a-1f9184c7b8f8", "content-length": "51", "date": "Mon, 25 Nov 2024 19:42:17 GMT"} })
119162024-11-25T19:42:17.506ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
119172024-11-25T19:42:17.506ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
119182024-11-25T19:42:17.549ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
119192024-11-25T19:42:17.549ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
119202024-11-25T19:42:17.580ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
119212024-11-25T19:42:17.580ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:44476
119222024-11-25T19:42:17.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:44476 req_id = 62309984-0d22-41a7-bedc-56f79cdc5ec9 roles = RoleSet { roles: {} } uri = /metrics/producers
119232024-11-25T19:42:17.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:44476 req_id = 62309984-0d22-41a7-bedc-56f79cdc5ec9 resource = Database result = Ok(()) uri = /metrics/producers
119242024-11-25T19:42:17.604ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8748d411-41da-44b4-a0d9-fc96fceddb50", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
119252024-11-25T19:42:17.604ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
119262024-11-25T19:42:17.604ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
119272024-11-25T19:42:17.605ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e5b2001-9a56-4350-a2c8-c31ca4be7d59", "content-length": "682", "date": "Mon, 25 Nov 2024 19:42:17 GMT"} })
119282024-11-25T19:42:17.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119292024-11-25T19:42:17.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119302024-11-25T19:42:17.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119312024-11-25T19:42:17.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119322024-11-25T19:42:17.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119332024-11-25T19:42:17.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119342024-11-25T19:42:17.614ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
119352024-11-25T19:42:17.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119362024-11-25T19:42:17.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34514 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:44476 req_id = 62309984-0d22-41a7-bedc-56f79cdc5ec9 response_code = 201 uri = /metrics/producers
119372024-11-25T19:42:17.614ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "62309984-0d22-41a7-bedc-56f79cdc5ec9", "content-length": "41", "date": "Mon, 25 Nov 2024 19:42:17 GMT"} })
119382024-11-25T19:42:17.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119392024-11-25T19:42:17.616ZDEBGnexus (producer-registration-task): registered with nexus successfully
119402024-11-25T19:42:17.616ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
119412024-11-25T19:42:17.622ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 771.135929ms iteration = 23 status = {}
119422024-11-25T19:42:18.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3961ddb8-c66f-4f4f-a366-4ff7758732b7 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119432024-11-25T19:42:18.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3961ddb8-c66f-4f4f-a366-4ff7758732b7 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119442024-11-25T19:42:18.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 3961ddb8-c66f-4f4f-a366-4ff7758732b7 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119452024-11-25T19:42:19.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 421b63f8-b600-4760-9c7c-029e4ab75f87 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119462024-11-25T19:42:19.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 421b63f8-b600-4760-9c7c-029e4ab75f87 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119472024-11-25T19:42:19.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 421b63f8-b600-4760-9c7c-029e4ab75f87 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119482024-11-25T19:42:20.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4b4a6800-a99e-40e9-8a84-b89abb0e5f2b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119492024-11-25T19:42:20.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4b4a6800-a99e-40e9-8a84-b89abb0e5f2b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119502024-11-25T19:42:20.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4b4a6800-a99e-40e9-8a84-b89abb0e5f2b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119512024-11-25T19:42:21.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 391a550c-8ec8-4177-8f44-0183d367d0f0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119522024-11-25T19:42:21.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 391a550c-8ec8-4177-8f44-0183d367d0f0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119532024-11-25T19:42:21.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 391a550c-8ec8-4177-8f44-0183d367d0f0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119542024-11-25T19:42:22.288ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 588 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = c6fea7fe-aadd-4ab6-8cc6-08cd488aa684 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
119552024-11-25T19:42:22.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e5580651-759b-4d4a-9c12-7a8ead111eb9 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119562024-11-25T19:42:22.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e5580651-759b-4d4a-9c12-7a8ead111eb9 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119572024-11-25T19:42:22.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e5580651-759b-4d4a-9c12-7a8ead111eb9 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119582024-11-25T19:42:23.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90ba4dd0-68c7-4e0c-b2f7-870680ec2b63 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119592024-11-25T19:42:23.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90ba4dd0-68c7-4e0c-b2f7-870680ec2b63 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119602024-11-25T19:42:23.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 90ba4dd0-68c7-4e0c-b2f7-870680ec2b63 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119612024-11-25T19:42:24.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e2782d39-909f-4088-834a-f3f3e47a87dd roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119622024-11-25T19:42:24.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e2782d39-909f-4088-834a-f3f3e47a87dd resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119632024-11-25T19:42:24.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e2782d39-909f-4088-834a-f3f3e47a87dd response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119642024-11-25T19:42:25.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7a9595e4-996b-4c20-8485-5e2ec0fbcee0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119652024-11-25T19:42:25.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7a9595e4-996b-4c20-8485-5e2ec0fbcee0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119662024-11-25T19:42:25.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2587 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7a9595e4-996b-4c20-8485-5e2ec0fbcee0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119672024-11-25T19:42:26.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 94511a01-70b5-4b84-afad-bb043e2e3f7f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119682024-11-25T19:42:26.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 94511a01-70b5-4b84-afad-bb043e2e3f7f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119692024-11-25T19:42:26.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 94511a01-70b5-4b84-afad-bb043e2e3f7f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119702024-11-25T19:42:26.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
119712024-11-25T19:42:26.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
119722024-11-25T19:42:26.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119732024-11-25T19:42:26.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119742024-11-25T19:42:26.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119752024-11-25T19:42:26.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119762024-11-25T19:42:26.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119772024-11-25T19:42:26.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
119782024-11-25T19:42:26.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119792024-11-25T19:42:26.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119802024-11-25T19:42:26.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119812024-11-25T19:42:26.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119822024-11-25T19:42:26.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119832024-11-25T19:42:26.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
119842024-11-25T19:42:26.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119852024-11-25T19:42:26.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119862024-11-25T19:42:26.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
119872024-11-25T19:42:26.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.997032ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
119882024-11-25T19:42:26.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119892024-11-25T19:42:26.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119902024-11-25T19:42:26.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.819375ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
119912024-11-25T19:42:27.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b29c981e-8c62-432b-aac0-17ad388eb19b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119922024-11-25T19:42:27.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b29c981e-8c62-432b-aac0-17ad388eb19b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119932024-11-25T19:42:27.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b29c981e-8c62-432b-aac0-17ad388eb19b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119942024-11-25T19:42:28.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 37915dbe-df57-47ff-8854-8807f0f975ca roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119952024-11-25T19:42:28.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 37915dbe-df57-47ff-8854-8807f0f975ca resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119962024-11-25T19:42:28.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 37915dbe-df57-47ff-8854-8807f0f975ca response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119972024-11-25T19:42:29.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 149706b1-20e2-45a2-bb0a-76c88a13606c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119982024-11-25T19:42:29.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 149706b1-20e2-45a2-bb0a-76c88a13606c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
119992024-11-25T19:42:29.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 149706b1-20e2-45a2-bb0a-76c88a13606c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120002024-11-25T19:42:30.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 60786b4e-afbf-4e58-8f8d-7342bd567e9f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120012024-11-25T19:42:30.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 60786b4e-afbf-4e58-8f8d-7342bd567e9f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120022024-11-25T19:42:30.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1864 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 60786b4e-afbf-4e58-8f8d-7342bd567e9f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120032024-11-25T19:42:31.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ff35c6c1-8f3a-4703-a81a-16d3507c07ab roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120042024-11-25T19:42:31.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ff35c6c1-8f3a-4703-a81a-16d3507c07ab resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120052024-11-25T19:42:31.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ff35c6c1-8f3a-4703-a81a-16d3507c07ab response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120062024-11-25T19:42:32.287ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 490 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = ef53302f-19e3-45e3-8393-ba5039b1205c response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
120072024-11-25T19:42:32.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 72395e7d-7960-4eab-b99e-8a2ef8daf5e2 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120082024-11-25T19:42:32.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 72395e7d-7960-4eab-b99e-8a2ef8daf5e2 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120092024-11-25T19:42:32.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 72395e7d-7960-4eab-b99e-8a2ef8daf5e2 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120102024-11-25T19:42:33.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7977df3b-d8bd-4c33-830c-1c9534bb8496 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120112024-11-25T19:42:33.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7977df3b-d8bd-4c33-830c-1c9534bb8496 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120122024-11-25T19:42:33.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7977df3b-d8bd-4c33-830c-1c9534bb8496 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120132024-11-25T19:42:34.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ffaae950-108d-4aec-94fa-98437758c185 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120142024-11-25T19:42:34.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ffaae950-108d-4aec-94fa-98437758c185 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120152024-11-25T19:42:34.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ffaae950-108d-4aec-94fa-98437758c185 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120162024-11-25T19:42:35.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ec21c987-f89a-4b8e-bcc4-b6b38eb35ceb roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120172024-11-25T19:42:35.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ec21c987-f89a-4b8e-bcc4-b6b38eb35ceb resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120182024-11-25T19:42:35.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ec21c987-f89a-4b8e-bcc4-b6b38eb35ceb response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120192024-11-25T19:42:36.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
120202024-11-25T19:42:36.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120212024-11-25T19:42:36.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
120222024-11-25T19:42:36.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120232024-11-25T19:42:36.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120242024-11-25T19:42:36.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120252024-11-25T19:42:36.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120262024-11-25T19:42:36.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120272024-11-25T19:42:36.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.405607ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120282024-11-25T19:42:36.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120292024-11-25T19:42:36.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120302024-11-25T19:42:36.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120312024-11-25T19:42:36.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120322024-11-25T19:42:36.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120332024-11-25T19:42:36.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120342024-11-25T19:42:36.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120352024-11-25T19:42:36.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
120362024-11-25T19:42:36.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120372024-11-25T19:42:36.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120382024-11-25T19:42:36.897ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
120392024-11-25T19:42:36.897ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.040813ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
120402024-11-25T19:42:37.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f755d5b2-efa4-44f6-987f-0793fcc248f5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120412024-11-25T19:42:37.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f755d5b2-efa4-44f6-987f-0793fcc248f5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120422024-11-25T19:42:37.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = f755d5b2-efa4-44f6-987f-0793fcc248f5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120432024-11-25T19:42:38.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 044c05ad-badf-4686-9c95-61a3ffd62374 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120442024-11-25T19:42:38.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 044c05ad-badf-4686-9c95-61a3ffd62374 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120452024-11-25T19:42:38.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 044c05ad-badf-4686-9c95-61a3ffd62374 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120462024-11-25T19:42:38.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 9693d57a-18ab-4833-97a5-899f51cbe04f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
120472024-11-25T19:42:38.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 9693d57a-18ab-4833-97a5-899f51cbe04f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
120482024-11-25T19:42:38.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 9693d57a-18ab-4833-97a5-899f51cbe04f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
120492024-11-25T19:42:38.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 764141a8-9415-427f-9864-588b0ee5000a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
120502024-11-25T19:42:38.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 764141a8-9415-427f-9864-588b0ee5000a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
120512024-11-25T19:42:38.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 764141a8-9415-427f-9864-588b0ee5000a response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
120522024-11-25T19:42:39.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e543f494-a16e-4bfe-94f5-6899ff5255e2 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120532024-11-25T19:42:39.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e543f494-a16e-4bfe-94f5-6899ff5255e2 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120542024-11-25T19:42:39.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e543f494-a16e-4bfe-94f5-6899ff5255e2 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120552024-11-25T19:42:40.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dd52dbd9-4f10-49eb-ae05-b7f2cc9319ea roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120562024-11-25T19:42:40.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dd52dbd9-4f10-49eb-ae05-b7f2cc9319ea resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120572024-11-25T19:42:40.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dd52dbd9-4f10-49eb-ae05-b7f2cc9319ea response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120582024-11-25T19:42:41.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1d226300-8c6d-41fb-85b2-306bd535f94d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120592024-11-25T19:42:41.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1d226300-8c6d-41fb-85b2-306bd535f94d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120602024-11-25T19:42:41.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1d226300-8c6d-41fb-85b2-306bd535f94d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120612024-11-25T19:42:42.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 569fa63d-d4db-43e9-8867-9336aa9b5a4d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120622024-11-25T19:42:42.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 569fa63d-d4db-43e9-8867-9336aa9b5a4d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120632024-11-25T19:42:42.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 569fa63d-d4db-43e9-8867-9336aa9b5a4d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120642024-11-25T19:42:42.287ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 581 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 1e65d3dd-e089-4327-9bfb-b0586b3fe300 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
120652024-11-25T19:42:43.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 43a904ec-e5da-42e5-9139-ce42a99aaf0a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120662024-11-25T19:42:43.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 43a904ec-e5da-42e5-9139-ce42a99aaf0a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120672024-11-25T19:42:43.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 43a904ec-e5da-42e5-9139-ce42a99aaf0a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120682024-11-25T19:42:44.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1a6e6ac0-0a49-42eb-992e-ea5c5e0510c1 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120692024-11-25T19:42:44.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1a6e6ac0-0a49-42eb-992e-ea5c5e0510c1 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120702024-11-25T19:42:44.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1a6e6ac0-0a49-42eb-992e-ea5c5e0510c1 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120712024-11-25T19:42:45.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4c4d03a4-74e7-4170-ac41-664193c1529e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120722024-11-25T19:42:45.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4c4d03a4-74e7-4170-ac41-664193c1529e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120732024-11-25T19:42:45.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4c4d03a4-74e7-4170-ac41-664193c1529e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120742024-11-25T19:42:46.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cd2afa82-af99-4c80-8322-0a864e21585a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120752024-11-25T19:42:46.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cd2afa82-af99-4c80-8322-0a864e21585a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120762024-11-25T19:42:46.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cd2afa82-af99-4c80-8322-0a864e21585a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
120772024-11-25T19:42:46.598ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d6066347-ac58-4a2d-871a-78d58f0a623f uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-25T19:42:46.581807079Z }
120782024-11-25T19:42:46.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d6066347-ac58-4a2d-871a-78d58f0a623f roles = RoleSet { roles: {} } uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
120792024-11-25T19:42:46.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d6066347-ac58-4a2d-871a-78d58f0a623f resource = Database result = Ok(()) uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
120802024-11-25T19:42:46.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69630 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d6066347-ac58-4a2d-871a-78d58f0a623f response_code = 204 uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
120812024-11-25T19:42:46.730ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1d856ff8-bd6e-41d7-afb8-add81364045d uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-25T19:42:46.729511617Z }
120822024-11-25T19:42:46.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1d856ff8-bd6e-41d7-afb8-add81364045d roles = RoleSet { roles: {} } uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
120832024-11-25T19:42:46.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1d856ff8-bd6e-41d7-afb8-add81364045d resource = Database result = Ok(()) uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
120842024-11-25T19:42:46.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57643 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1d856ff8-bd6e-41d7-afb8-add81364045d response_code = 204 uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
120852024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
120862024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
120872024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
120882024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
120892024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
120902024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
120912024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
120922024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
120932024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
120942024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
120952024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
120962024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120972024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
120982024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
120992024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
121002024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
121012024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
121022024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
121032024-11-25T19:42:46.851ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
121042024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
121052024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121062024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121072024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
121082024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
121092024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121102024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
121112024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121122024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121132024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
121142024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
121152024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
121162024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
121172024-11-25T19:42:46.851ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
121182024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
121192024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
121202024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
121212024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
121222024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121232024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
121242024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
121252024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
121262024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121272024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
121282024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121292024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121302024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
121312024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
121322024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121332024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
121342024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
121352024-11-25T19:42:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121362024-11-25T19:42:46.856ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.327665ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
121372024-11-25T19:42:46.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121382024-11-25T19:42:46.856ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1792, tv_nsec: 399367102 } })
121392024-11-25T19:42:46.856ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
121402024-11-25T19:42:46.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
121412024-11-25T19:42:46.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121422024-11-25T19:42:46.858ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
121432024-11-25T19:42:46.858ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
121442024-11-25T19:42:46.858ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
121452024-11-25T19:42:46.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121462024-11-25T19:42:46.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
121472024-11-25T19:42:46.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1792, tv_nsec: 404581754 } })
121482024-11-25T19:42:46.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
121492024-11-25T19:42:46.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121502024-11-25T19:42:46.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
121512024-11-25T19:42:46.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121522024-11-25T19:42:46.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121532024-11-25T19:42:46.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121542024-11-25T19:42:46.870ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1792, tv_nsec: 413177183 } })
121552024-11-25T19:42:46.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121562024-11-25T19:42:46.870ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
121572024-11-25T19:42:46.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121582024-11-25T19:42:46.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
121592024-11-25T19:42:46.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121602024-11-25T19:42:46.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121612024-11-25T19:42:46.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121622024-11-25T19:42:46.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121632024-11-25T19:42:46.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121642024-11-25T19:42:46.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
121652024-11-25T19:42:46.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121662024-11-25T19:42:46.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121672024-11-25T19:42:46.888ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
121682024-11-25T19:42:46.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
121692024-11-25T19:42:46.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121702024-11-25T19:42:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
121712024-11-25T19:42:46.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121722024-11-25T19:42:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121732024-11-25T19:42:46.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121742024-11-25T19:42:46.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.122823ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
121752024-11-25T19:42:46.905ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
121762024-11-25T19:42:46.905ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.779295ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
121772024-11-25T19:42:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
121782024-11-25T19:42:46.905ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
121792024-11-25T19:42:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
121802024-11-25T19:42:46.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121812024-11-25T19:42:46.906ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121822024-11-25T19:42:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121832024-11-25T19:42:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121842024-11-25T19:42:46.906ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
121852024-11-25T19:42:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
121862024-11-25T19:42:46.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.445797ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
121872024-11-25T19:42:46.908ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
121882024-11-25T19:42:46.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
121892024-11-25T19:42:46.914ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
121902024-11-25T19:42:46.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
121912024-11-25T19:42:46.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.789952ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
121922024-11-25T19:42:46.916ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 64.566977ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
121932024-11-25T19:42:46.917ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
121942024-11-25T19:42:46.917ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
121952024-11-25T19:42:46.917ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
121962024-11-25T19:42:46.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
121972024-11-25T19:42:46.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121982024-11-25T19:42:46.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
121992024-11-25T19:42:46.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122002024-11-25T19:42:46.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122012024-11-25T19:42:46.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122022024-11-25T19:42:46.925ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122032024-11-25T19:42:46.925ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122042024-11-25T19:42:46.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122052024-11-25T19:42:46.926ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122062024-11-25T19:42:46.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
122072024-11-25T19:42:46.928ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122082024-11-25T19:42:46.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122092024-11-25T19:42:46.931ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
122102024-11-25T19:42:46.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
122112024-11-25T19:42:46.942ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122122024-11-25T19:42:46.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122132024-11-25T19:42:46.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 94.2787ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
122142024-11-25T19:42:46.953ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
122152024-11-25T19:42:46.953ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
122162024-11-25T19:42:46.953ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 101.860378ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
122172024-11-25T19:42:46.978ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
122182024-11-25T19:42:46.978ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122192024-11-25T19:42:46.979ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e1485af-bc3e-4037-b001-989e317b1ffb", "content-length": "26", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
122202024-11-25T19:42:46.979ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122212024-11-25T19:42:46.982ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122222024-11-25T19:42:46.988ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
122232024-11-25T19:42:46.988ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122242024-11-25T19:42:46.988ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab9578b5-f395-4f49-b7c7-80acdeddedc6", "content-length": "26", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
122252024-11-25T19:42:46.988ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122262024-11-25T19:42:46.990ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
122272024-11-25T19:42:47.017ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
122282024-11-25T19:42:47.017ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122292024-11-25T19:42:47.017ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7e1c8ac-3b04-4dd5-b3b5-f496b5037050", "content-length": "26", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
122302024-11-25T19:42:47.017ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122312024-11-25T19:42:47.020ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122322024-11-25T19:42:47.020ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122332024-11-25T19:42:47.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122342024-11-25T19:42:47.035ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 184.04323ms iteration = 27 status = {"physical_disks_added":0}
122352024-11-25T19:42:47.078ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/40644ff1-5ecb-4152-92fd-205456a7f844/state
122362024-11-25T19:42:47.082ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/40644ff1-5ecb-4152-92fd-205456a7f844/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab954ec1-4806-46d3-848b-4297258875db", "content-length": "130", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
122372024-11-25T19:42:47.083ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
122382024-11-25T19:42:47.083ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
122392024-11-25T19:42:47.083ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "eed725a6-3398-43b1-bef5-66accf233311", "content-length": "585", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
122402024-11-25T19:42:47.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122412024-11-25T19:42:47.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122422024-11-25T19:42:47.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122432024-11-25T19:42:47.087ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122442024-11-25T19:42:47.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122452024-11-25T19:42:47.090ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
122462024-11-25T19:42:47.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122472024-11-25T19:42:47.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122482024-11-25T19:42:47.092ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122492024-11-25T19:42:47.092ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = b9902981-e922-4cfe-9602-2068a262a7ba sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-25T19:42:46.729511617Z }, migration_in: None, migration_out: None } vmm_id = 40644ff1-5ecb-4152-92fd-205456a7f844
122502024-11-25T19:42:47.092ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2116 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b vmm_id = 40644ff1-5ecb-4152-92fd-205456a7f844 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-25T19:42:46.729511617Z }
122512024-11-25T19:42:47.092ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = b9902981-e922-4cfe-9602-2068a262a7ba roles = RoleSet { roles: {} } sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b vmm_id = 40644ff1-5ecb-4152-92fd-205456a7f844
122522024-11-25T19:42:47.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = b9902981-e922-4cfe-9602-2068a262a7ba resource = Database result = Ok(()) sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b vmm_id = 40644ff1-5ecb-4152-92fd-205456a7f844
122532024-11-25T19:42:47.095ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
122542024-11-25T19:42:47.095ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122552024-11-25T19:42:47.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122562024-11-25T19:42:47.095ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 243.850553ms iteration = 24 status = {}
122572024-11-25T19:42:47.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 265.790914ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
122582024-11-25T19:42:47.118ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
122592024-11-25T19:42:47.118ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "515c318d-c20b-4de3-99b6-3df98bc938a3", "content-length": "1", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
122602024-11-25T19:42:47.120ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
122612024-11-25T19:42:47.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
122622024-11-25T19:42:47.123ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 272.066447ms iteration = 24 status = null
122632024-11-25T19:42:47.128ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122642024-11-25T19:42:47.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
122652024-11-25T19:42:47.132ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122662024-11-25T19:42:47.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122672024-11-25T19:42:47.133ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
122682024-11-25T19:42:47.135ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 283.38883ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
122692024-11-25T19:42:47.135ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 283.42685ms iteration = 24 status = 0
122702024-11-25T19:42:47.167ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {8d77fd96-7e85-482e-b197-592d80fc5793: {10.151.1.175: {15fc98e0-962c-43e7-8e4b-b9da5489f367}, 10.151.1.176: {15fc98e0-962c-43e7-8e4b-b9da5489f367}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
122712024-11-25T19:42:47.167ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
122722024-11-25T19:42:47.168ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2eaac953-a6c7-4aed-baed-7fee5cdbb5e1", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
122732024-11-25T19:42:47.168ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122742024-11-25T19:42:47.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122752024-11-25T19:42:47.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122762024-11-25T19:42:47.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122772024-11-25T19:42:47.175ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122782024-11-25T19:42:47.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122792024-11-25T19:42:47.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122802024-11-25T19:42:47.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122812024-11-25T19:42:47.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122822024-11-25T19:42:47.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122832024-11-25T19:42:47.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122842024-11-25T19:42:47.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122852024-11-25T19:42:47.191ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
122862024-11-25T19:42:47.191ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
122872024-11-25T19:42:47.191ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
122882024-11-25T19:42:47.192ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "40b27034-8333-4aa6-8c7f-2c042219440d", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
122892024-11-25T19:42:47.194ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 342.205233ms iteration = 24 status = {}
122902024-11-25T19:42:47.238ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
122912024-11-25T19:42:47.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122922024-11-25T19:42:47.238ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7507c80-1d6e-4e5b-b4f4-6475b10bb33a", "content-length": "811", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
122932024-11-25T19:42:47.238ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(14052216) }} sled = buskin
122942024-11-25T19:42:47.238ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
122952024-11-25T19:42:47.238ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
122962024-11-25T19:42:47.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122972024-11-25T19:42:47.241ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 389.205156ms iteration = 24 status = {}
122982024-11-25T19:42:47.241ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
122992024-11-25T19:42:47.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123002024-11-25T19:42:47.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123012024-11-25T19:42:47.252ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
123022024-11-25T19:42:47.252ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba35af35-a4ab-4ed6-ba8d-fc85b09d658e", "content-length": "134", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
123032024-11-25T19:42:47.252ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
123042024-11-25T19:42:47.252ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
123052024-11-25T19:42:47.252ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
123062024-11-25T19:42:47.252ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
123072024-11-25T19:42:47.252ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123082024-11-25T19:42:47.252ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123092024-11-25T19:42:47.252ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123102024-11-25T19:42:47.252ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
123112024-11-25T19:42:47.252ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123122024-11-25T19:42:47.252ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
123132024-11-25T19:42:47.253ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
123142024-11-25T19:42:47.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123152024-11-25T19:42:47.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123162024-11-25T19:42:47.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d590eae2-4da2-4f89-a485-35f606a28f7a roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123172024-11-25T19:42:47.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d590eae2-4da2-4f89-a485-35f606a28f7a resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123182024-11-25T19:42:47.255ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
123192024-11-25T19:42:47.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d590eae2-4da2-4f89-a485-35f606a28f7a response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123202024-11-25T19:42:47.256ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "be4b58ad-a98f-44c9-9d03-246c73f18757", "content-length": "2", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
123212024-11-25T19:42:47.256ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
123222024-11-25T19:42:47.256ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b51a57b2-ab9e-4506-aa1e-a91fa1809a84", "content-length": "51", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
123232024-11-25T19:42:47.256ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
123242024-11-25T19:42:47.256ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
123252024-11-25T19:42:47.347ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fe3d0953-30ae-4386-9d14-0ce4c7a2cf2e", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
123262024-11-25T19:42:47.347ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
123272024-11-25T19:42:47.347ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
123282024-11-25T19:42:47.347ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c74af97-2983-47b3-ac1e-706e673047ff", "content-length": "682", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
123292024-11-25T19:42:47.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123302024-11-25T19:42:47.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123312024-11-25T19:42:47.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123322024-11-25T19:42:47.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123332024-11-25T19:42:47.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123342024-11-25T19:42:47.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123352024-11-25T19:42:47.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123362024-11-25T19:42:47.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123372024-11-25T19:42:47.363ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 511.945284ms iteration = 24 status = {}
123382024-11-25T19:42:48.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c39af2a0-ba0a-4521-bf5f-3ec8ea2824c6 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123392024-11-25T19:42:48.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c39af2a0-ba0a-4521-bf5f-3ec8ea2824c6 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123402024-11-25T19:42:48.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c39af2a0-ba0a-4521-bf5f-3ec8ea2824c6 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123412024-11-25T19:42:49.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a2e61490-9198-487d-9c91-72dc4e760d64 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123422024-11-25T19:42:49.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a2e61490-9198-487d-9c91-72dc4e760d64 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123432024-11-25T19:42:49.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a2e61490-9198-487d-9c91-72dc4e760d64 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123442024-11-25T19:42:50.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dd0244e0-f4e3-4767-a30a-bf7c4ffab28c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123452024-11-25T19:42:50.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dd0244e0-f4e3-4767-a30a-bf7c4ffab28c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123462024-11-25T19:42:50.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2739 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dd0244e0-f4e3-4767-a30a-bf7c4ffab28c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123472024-11-25T19:42:51.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b31a7974-438a-489f-8c43-63952cd74fb5 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123482024-11-25T19:42:51.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b31a7974-438a-489f-8c43-63952cd74fb5 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123492024-11-25T19:42:51.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2896 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = b31a7974-438a-489f-8c43-63952cd74fb5 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123502024-11-25T19:42:52.290ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2914 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = fb579576-20c2-448a-aa6a-bcb232744978 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
123512024-11-25T19:42:52.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 094f5eab-17ea-4bc5-a11b-e85d07b6f4a0 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123522024-11-25T19:42:52.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 094f5eab-17ea-4bc5-a11b-e85d07b6f4a0 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123532024-11-25T19:42:52.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2719 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 094f5eab-17ea-4bc5-a11b-e85d07b6f4a0 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123542024-11-25T19:42:53.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d0505292-eba8-48b5-a7b3-c114365d56a4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123552024-11-25T19:42:53.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d0505292-eba8-48b5-a7b3-c114365d56a4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123562024-11-25T19:42:53.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d0505292-eba8-48b5-a7b3-c114365d56a4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123572024-11-25T19:42:54.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 12f243b8-26a6-47a3-b366-d6e854b1186d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123582024-11-25T19:42:54.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 12f243b8-26a6-47a3-b366-d6e854b1186d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123592024-11-25T19:42:54.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 12f243b8-26a6-47a3-b366-d6e854b1186d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123602024-11-25T19:42:55.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6065c3af-61b5-4210-b422-bfceb21d5caf roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123612024-11-25T19:42:55.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6065c3af-61b5-4210-b422-bfceb21d5caf resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123622024-11-25T19:42:55.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 6065c3af-61b5-4210-b422-bfceb21d5caf response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123632024-11-25T19:42:56.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ea77c3e4-a696-4f9d-b907-3adbd5d4e420 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123642024-11-25T19:42:56.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ea77c3e4-a696-4f9d-b907-3adbd5d4e420 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123652024-11-25T19:42:56.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ea77c3e4-a696-4f9d-b907-3adbd5d4e420 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123662024-11-25T19:42:56.842ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 80369396-06e8-46c1-8dec-454141d50575 uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-25T19:42:56.842607984Z }
123672024-11-25T19:42:56.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 80369396-06e8-46c1-8dec-454141d50575 roles = RoleSet { roles: {} } uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
123682024-11-25T19:42:56.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 80369396-06e8-46c1-8dec-454141d50575 resource = Database result = Ok(()) uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
123692024-11-25T19:42:56.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
123702024-11-25T19:42:56.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
123712024-11-25T19:42:56.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123722024-11-25T19:42:56.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123732024-11-25T19:42:56.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123742024-11-25T19:42:56.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123752024-11-25T19:42:56.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123762024-11-25T19:42:56.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
123772024-11-25T19:42:56.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123782024-11-25T19:42:56.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123792024-11-25T19:42:56.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43813 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 80369396-06e8-46c1-8dec-454141d50575 response_code = 204 uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
123802024-11-25T19:42:56.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123812024-11-25T19:42:56.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123822024-11-25T19:42:56.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123832024-11-25T19:42:56.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123842024-11-25T19:42:56.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.092797ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123852024-11-25T19:42:56.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123862024-11-25T19:42:56.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
123872024-11-25T19:42:56.921ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123882024-11-25T19:42:56.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123892024-11-25T19:42:56.937ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
123902024-11-25T19:42:56.937ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.910386ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
123912024-11-25T19:42:57.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5bf64d22-5234-408f-aeaf-81f7edc4054b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123922024-11-25T19:42:57.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5bf64d22-5234-408f-aeaf-81f7edc4054b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123932024-11-25T19:42:57.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5bf64d22-5234-408f-aeaf-81f7edc4054b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
123942024-11-25T19:42:57.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 596afb87-a68d-49ea-9d4c-5f04c32bfcc1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
123952024-11-25T19:42:57.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 596afb87-a68d-49ea-9d4c-5f04c32bfcc1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
123962024-11-25T19:42:57.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 596afb87-a68d-49ea-9d4c-5f04c32bfcc1 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
123972024-11-25T19:42:57.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 21c669d4-4b78-47f8-9f1f-b5c819fc778e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
123982024-11-25T19:42:57.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 21c669d4-4b78-47f8-9f1f-b5c819fc778e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
123992024-11-25T19:42:57.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 21c669d4-4b78-47f8-9f1f-b5c819fc778e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
124002024-11-25T19:42:58.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 37da5d95-851a-40a8-a647-016653650e58 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
124012024-11-25T19:42:58.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 37da5d95-851a-40a8-a647-016653650e58 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
124022024-11-25T19:42:58.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 37da5d95-851a-40a8-a647-016653650e58 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
124032024-11-25T19:42:58.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 4ad761f8-09b4-4c1e-87e2-357582750a85 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
124042024-11-25T19:42:58.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 4ad761f8-09b4-4c1e-87e2-357582750a85 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
124052024-11-25T19:42:58.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 4ad761f8-09b4-4c1e-87e2-357582750a85 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
124062024-11-25T19:42:59.316ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-25T19:42:59.316366659Z }
124072024-11-25T19:42:59.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f roles = RoleSet { roles: {} } uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124082024-11-25T19:42:59.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f resource = Database result = Ok(()) uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124092024-11-25T19:42:59.331ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844 vmm_needs_update = true
124102024-11-25T19:42:59.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f roles = RoleSet { roles: {} } uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124112024-11-25T19:42:59.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f resource = Database result = Ok(()) uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124122024-11-25T19:42:59.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f roles = RoleSet { roles: {} } uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124132024-11-25T19:42:59.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f resource = Database result = Ok(()) uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124142024-11-25T19:42:59.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f roles = RoleSet { roles: {} } uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124152024-11-25T19:42:59.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f resource = Database result = Ok(()) uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124162024-11-25T19:42:59.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f roles = RoleSet { roles: {} } uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124172024-11-25T19:42:59.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f resource = Database result = Ok(()) uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124182024-11-25T19:42:59.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f roles = RoleSet { roles: {} } uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124192024-11-25T19:42:59.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f resource = Database result = Ok(()) uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124202024-11-25T19:42:59.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f roles = RoleSet { roles: {} } uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124212024-11-25T19:42:59.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f resource = Database result = Ok(()) uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124222024-11-25T19:42:59.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124232024-11-25T19:42:59.380ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b0ee39e3-ee2b-42ea-a096-0949e0c7b88f, lookup_type: ById(b0ee39e3-ee2b-42ea-a096-0949e0c7b88f) }, key: b9902981-e922-4cfe-9602-2068a262a7ba, lookup_type: ById(b9902981-e922-4cfe-9602-2068a262a7ba) } result = Ok(()) uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124242024-11-25T19:42:59.387ZINFOnexus (dropshot_internal): starting update saga for b9902981-e922-4cfe-9602-2068a262a7ba actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-25T19:42:59.316366659Z }
124252024-11-25T19:42:59.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70914 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f response_code = 204 uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124262024-11-25T19:42:59.387ZDEBGnexus (dropshot_internal): preparing instance-update saga for b9902981-e922-4cfe-9602-2068a262a7ba... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = b9902981-e922-4cfe-9602-2068a262a7ba local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d4e138b4-bc92-4347-9c56-3d0e1bf8226f uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124272024-11-25T19:42:59.387ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update
124282024-11-25T19:42:59.388ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 31e2f235-2c89-4e6c-8aeb-4650ed65ab50 uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-25T19:42:59.316366659Z }
124292024-11-25T19:42:59.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 31e2f235-2c89-4e6c-8aeb-4650ed65ab50 roles = RoleSet { roles: {} } uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124302024-11-25T19:42:59.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 31e2f235-2c89-4e6c-8aeb-4650ed65ab50 resource = Database result = Ok(()) uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124312024-11-25T19:42:59.392ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"b9902981-e922-4cfe-9602-2068a262a7ba","lookup_type":{"ById":"b9902981-e922-4cfe-9602-2068a262a7ba"},"parent":{"key":"b0ee39e3-ee2b-42ea-a096-0949e0c7b88f","lookup_type":{"ById":"b0ee39e3-ee2b-42ea-a096-0949e0c7b88f"},"parent":{"key":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","lookup_type":{"ById":"d67475c9-87ae-4d90-9f64-ff01c1ac932d"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
124322024-11-25T19:42:59.392ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update
124332024-11-25T19:42:59.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30527 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 31e2f235-2c89-4e6c-8aeb-4650ed65ab50 response_code = 204 uri = /vmms/40644ff1-5ecb-4152-92fd-205456a7f844
124342024-11-25T19:42:59.432ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update
124352024-11-25T19:42:59.432ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
124362024-11-25T19:42:59.439ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
124372024-11-25T19:42:59.439ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a
124382024-11-25T19:42:59.445ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
124392024-11-25T19:42:59.445ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a
124402024-11-25T19:42:59.451ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
124412024-11-25T19:42:59.451ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a
124422024-11-25T19:42:59.460ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
124432024-11-25T19:42:59.460ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("9d473148-1912-46a9-ae6d-f53d4926c7ff")) node_id = 0 saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a
124442024-11-25T19:42:59.465ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
124452024-11-25T19:42:59.465ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a
124462024-11-25T19:42:59.477ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update
124472024-11-25T19:42:59.481ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124482024-11-25T19:42:59.482ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124492024-11-25T19:42:59.483ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124502024-11-25T19:42:59.483ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124512024-11-25T19:42:59.485ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124522024-11-25T19:42:59.485ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124532024-11-25T19:42:59.492ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124542024-11-25T19:42:59.492ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124552024-11-25T19:42:59.494ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124562024-11-25T19:42:59.494ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124572024-11-25T19:42:59.495ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124582024-11-25T19:42:59.495ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124592024-11-25T19:42:59.496ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124602024-11-25T19:42:59.501ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b0ee39e3-ee2b-42ea-a096-0949e0c7b88f, lookup_type: ById(b0ee39e3-ee2b-42ea-a096-0949e0c7b88f) }, key: b9902981-e922-4cfe-9602-2068a262a7ba, lookup_type: ById(b9902981-e922-4cfe-9602-2068a262a7ba) } result = Ok(()) saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124612024-11-25T19:42:59.501ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = b9902981-e922-4cfe-9602-2068a262a7ba saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance updater_id = 9d473148-1912-46a9-ae6d-f53d4926c7ff
124622024-11-25T19:42:59.501ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124632024-11-25T19:42:59.502ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124642024-11-25T19:42:59.518ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = b9902981-e922-4cfe-9602-2068a262a7ba saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance updater_id = 9d473148-1912-46a9-ae6d-f53d4926c7ff
124652024-11-25T19:42:59.519ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124662024-11-25T19:42:59.519ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance
124672024-11-25T19:42:59.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aeaec986-ad93-470e-bed5-8d44f86a811d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
124682024-11-25T19:42:59.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aeaec986-ad93-470e-bed5-8d44f86a811d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
124692024-11-25T19:42:59.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1779 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = aeaec986-ad93-470e-bed5-8d44f86a811d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
124702024-11-25T19:42:59.526ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = b9902981-e922-4cfe-9602-2068a262a7ba locked_gen = Generation(Generation(2)) saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = LockInstance updater_id = 9d473148-1912-46a9-ae6d-f53d4926c7ff
124712024-11-25T19:42:59.528ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
124722024-11-25T19:42:59.528ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("9d473148-1912-46a9-ae6d-f53d4926c7ff")}) node_id = 1 saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a
124732024-11-25T19:42:59.533ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
124742024-11-25T19:42:59.533ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a
124752024-11-25T19:42:59.540ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
124762024-11-25T19:42:59.540ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
124772024-11-25T19:42:59.542ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
124782024-11-25T19:42:59.542ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
124792024-11-25T19:42:59.543ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
124802024-11-25T19:42:59.543ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
124812024-11-25T19:42:59.545ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
124822024-11-25T19:42:59.548ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b0ee39e3-ee2b-42ea-a096-0949e0c7b88f, lookup_type: ById(b0ee39e3-ee2b-42ea-a096-0949e0c7b88f) }, key: b9902981-e922-4cfe-9602-2068a262a7ba, lookup_type: ById(b9902981-e922-4cfe-9602-2068a262a7ba) } result = Ok(()) saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
124832024-11-25T19:42:59.548ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
124842024-11-25T19:42:59.548ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
124852024-11-25T19:42:59.554ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 40644ff1-5ecb-4152-92fd-205456a7f844, time_created: 2024-11-25T19:42:38.592326Z, time_deleted: None, instance_id: b9902981-e922-4cfe-9602-2068a262a7ba, sled_id: 38711855-ef69-4d79-bb75-aebd85b1280b, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-25T19:42:59.316366Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-25T19:42:36.469820Z, gen: Generation(Generation(3)), propolis_id: Some(40644ff1-5ecb-4152-92fd-205456a7f844), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(40644ff1-5ecb-4152-92fd-205456a7f844 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-25T19:42:59.554037252Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
124862024-11-25T19:42:59.561ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update
124872024-11-25T19:42:59.561ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"b9902981-e922-4cfe-9602-2068a262a7ba","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"40644ff1-5ecb-4152-92fd-205456a7f844"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"b9902981-e922-4cfe-9602-2068a262a7ba","lookup_type":{"ById":"b9902981-e922-4cfe-9602-2068a262a7ba"},"parent":{"key":"b0ee39e3-ee2b-42ea-a096-0949e0c7b88f","lookup_type":{"ById":"b0ee39e3-ee2b-42ea-a096-0949e0c7b88f"},"parent":{"key":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","lookup_type":{"ById":"d67475c9-87ae-4d90-9f64-ff01c1ac932d"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"9d473148-1912-46a9-ae6d-f53d4926c7ff"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"b0ee39e3-ee2b-42ea-a096-0949e0c7b88f","ram_diff":1073741824},"destroy_active_vmm":"40644ff1-5ecb-4152-92fd-205456a7f844","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-25T19:42:59.554037252Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
124882024-11-25T19:42:59.561ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update
124892024-11-25T19:42:59.593ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update
124902024-11-25T19:42:59.593ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
124912024-11-25T19:42:59.593ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
124922024-11-25T19:42:59.593ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
124932024-11-25T19:42:59.598ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
124942024-11-25T19:42:59.598ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
124952024-11-25T19:42:59.603ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
124962024-11-25T19:42:59.603ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
124972024-11-25T19:42:59.608ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
124982024-11-25T19:42:59.608ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("a4d7f8e5-d349-4dda-973b-2e57165e026c")) node_id = 0 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
124992024-11-25T19:42:59.612ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
125002024-11-25T19:42:59.612ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
125012024-11-25T19:42:59.618ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = b9902981-e922-4cfe-9602-2068a262a7ba parent_lock = UpdaterLock { updater_id: 9d473148-1912-46a9-ae6d-f53d4926c7ff, locked_gen: Generation(Generation(2)) } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update
125022024-11-25T19:42:59.618ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = BecomeUpdater
125032024-11-25T19:42:59.619ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = BecomeUpdater
125042024-11-25T19:42:59.634ZDEBGnexus (SagaExecutor): inherited lock from 9d473148-1912-46a9-ae6d-f53d4926c7ff to a4d7f8e5-d349-4dda-973b-2e57165e026c actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = b9902981-e922-4cfe-9602-2068a262a7ba locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 9d473148-1912-46a9-ae6d-f53d4926c7ff saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = BecomeUpdater updater_id = a4d7f8e5-d349-4dda-973b-2e57165e026c
125052024-11-25T19:42:59.634ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update
125062024-11-25T19:42:59.634ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
125072024-11-25T19:42:59.634ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a4d7f8e5-d349-4dda-973b-2e57165e026c")}) node_id = 1 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
125082024-11-25T19:42:59.638ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
125092024-11-25T19:42:59.638ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
125102024-11-25T19:42:59.643ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
125112024-11-25T19:42:59.643ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
125122024-11-25T19:42:59.647ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
125132024-11-25T19:42:59.647ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
125142024-11-25T19:42:59.651ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update
125152024-11-25T19:42:59.654ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba
125162024-11-25T19:42:59.654ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = UpdateNetworkConfig
125172024-11-25T19:42:59.654ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = UpdateNetworkConfig
125182024-11-25T19:42:59.656ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = UpdateNetworkConfig
125192024-11-25T19:42:59.656ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = UpdateNetworkConfig
125202024-11-25T19:42:59.661ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
125212024-11-25T19:42:59.661ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = UpdateNetworkConfig
125222024-11-25T19:42:59.661ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = UpdateNetworkConfig
125232024-11-25T19:42:59.663ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
125242024-11-25T19:42:59.663ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
125252024-11-25T19:42:59.663ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
125262024-11-25T19:42:59.664ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
125272024-11-25T19:42:59.666ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
125282024-11-25T19:42:59.666ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
125292024-11-25T19:42:59.666ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
125302024-11-25T19:42:59.670ZDEBGnexus: notifying dendrite of updates instance_id = Some(b9902981-e922-4cfe-9602-2068a262a7ba (instance)) switch = switch0
125312024-11-25T19:42:59.671ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1805, tv_nsec: 213998965 } })
125322024-11-25T19:42:59.671ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
125332024-11-25T19:42:59.701ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
125342024-11-25T19:42:59.701ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125352024-11-25T19:42:59.702ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f121d06-1fc0-42d3-8f53-5f3e2b6feb0d", "content-length": "26", "date": "Mon, 25 Nov 2024 19:42:59 GMT"} })
125362024-11-25T19:42:59.702ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125372024-11-25T19:42:59.702ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
125382024-11-25T19:42:59.732ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
125392024-11-25T19:42:59.732ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "61eb6b45-2097-43b8-92e2-476475cda9ec", "content-length": "4", "date": "Mon, 25 Nov 2024 19:42:59 GMT"} })
125402024-11-25T19:42:59.733ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
125412024-11-25T19:42:59.733ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
125422024-11-25T19:42:59.737ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
125432024-11-25T19:42:59.737ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
125442024-11-25T19:42:59.740ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
125452024-11-25T19:42:59.740ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
125462024-11-25T19:42:59.757ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-25T19:42:59.745329Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: b0ee39e3-ee2b-42ea-a096-0949e0c7b88f, time_modified: Some(2024-11-25T19:42:59.745329Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, time_modified: Some(2024-11-25T19:42:59.745329Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update
125472024-11-25T19:42:59.757ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
125482024-11-25T19:42:59.757ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
125492024-11-25T19:42:59.760ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
125502024-11-25T19:42:59.760ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
125512024-11-25T19:42:59.766ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update
125522024-11-25T19:42:59.766ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = UnassignOximeterProducer
125532024-11-25T19:42:59.766ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = UnassignOximeterProducer
125542024-11-25T19:42:59.769ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 producer_id = b9902981-e922-4cfe-9602-2068a262a7ba saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update
125552024-11-25T19:42:59.769ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = UnassignOximeterProducer
125562024-11-25T19:42:59.769ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = UnassignOximeterProducer
125572024-11-25T19:42:59.806ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = b9902981-e922-4cfe-9602-2068a262a7ba saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update
125582024-11-25T19:42:59.808ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = b9902981-e922-4cfe-9602-2068a262a7ba saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/b9902981-e922-4cfe-9602-2068a262a7ba
125592024-11-25T19:42:59.821ZDEBGnexus (SagaExecutor): client response oximeter-collector = b9902981-e922-4cfe-9602-2068a262a7ba result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/b9902981-e922-4cfe-9602-2068a262a7ba", status: 204, headers: {"x-request-id": "d5893b51-3e46-420b-9ab4-aeb415586a5c", "date": "Mon, 25 Nov 2024 19:42:59 GMT"} }) saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update
125602024-11-25T19:42:59.821ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 producer_id = b9902981-e922-4cfe-9602-2068a262a7ba saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update
125612024-11-25T19:42:59.822ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
125622024-11-25T19:42:59.822ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
125632024-11-25T19:42:59.825ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
125642024-11-25T19:42:59.825ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
125652024-11-25T19:42:59.831ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = b9902981-e922-4cfe-9602-2068a262a7ba lock = UpdaterLock { updater_id: a4d7f8e5-d349-4dda-973b-2e57165e026c, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-25T19:42:59.554037252Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update
125662024-11-25T19:42:59.831ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = CommitInstanceUpdates
125672024-11-25T19:42:59.831ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = CommitInstanceUpdates
125682024-11-25T19:42:59.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = ffa3e4ba-0f76-4df8-9f9b-793ee5928f4c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
125692024-11-25T19:42:59.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = ffa3e4ba-0f76-4df8-9f9b-793ee5928f4c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
125702024-11-25T19:42:59.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = ffa3e4ba-0f76-4df8-9f9b-793ee5928f4c response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
125712024-11-25T19:42:59.874ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba new_runtime = InstanceRuntimeState { time_updated: 2024-11-25T19:42:59.554037252Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update
125722024-11-25T19:42:59.874ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
125732024-11-25T19:42:59.874ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
125742024-11-25T19:42:59.874ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
125752024-11-25T19:42:59.874ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Signaled
125762024-11-25T19:42:59.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125772024-11-25T19:42:59.874ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
125782024-11-25T19:42:59.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125792024-11-25T19:42:59.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125802024-11-25T19:42:59.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125812024-11-25T19:42:59.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125822024-11-25T19:42:59.877ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
125832024-11-25T19:42:59.877ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
125842024-11-25T19:42:59.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
125852024-11-25T19:42:59.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125862024-11-25T19:42:59.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125872024-11-25T19:42:59.879ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125882024-11-25T19:42:59.880ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
125892024-11-25T19:42:59.880ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("b9902981-e922-4cfe-9602-2068a262a7ba"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("40644ff1-5ecb-4152-92fd-205456a7f844")}) node_id = 7 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
125902024-11-25T19:42:59.881ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
125912024-11-25T19:42:59.881ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125922024-11-25T19:42:59.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125932024-11-25T19:42:59.884ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
125942024-11-25T19:42:59.884ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
125952024-11-25T19:42:59.887ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
125962024-11-25T19:42:59.887ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
125972024-11-25T19:42:59.890ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
125982024-11-25T19:42:59.890ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
125992024-11-25T19:42:59.895ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update
126002024-11-25T19:42:59.895ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = ReleaseSledResources
126012024-11-25T19:42:59.896ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = ReleaseSledResources
126022024-11-25T19:42:59.911ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
126032024-11-25T19:42:59.911ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
126042024-11-25T19:42:59.915ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
126052024-11-25T19:42:59.915ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
126062024-11-25T19:42:59.919ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update
126072024-11-25T19:42:59.919ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = MarkVmmDeleted
126082024-11-25T19:42:59.919ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = MarkVmmDeleted
126092024-11-25T19:42:59.947ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126102024-11-25T19:42:59.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126112024-11-25T19:42:59.963ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
126122024-11-25T19:42:59.963ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
126132024-11-25T19:42:59.970ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
126142024-11-25T19:42:59.970ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
126152024-11-25T19:42:59.975ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
126162024-11-25T19:42:59.975ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
126172024-11-25T19:42:59.977ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
126182024-11-25T19:42:59.977ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
126192024-11-25T19:42:59.977ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "aae6e374-5041-4fa6-b8e6-84febf3f8f2f", "content-length": "372", "date": "Mon, 25 Nov 2024 19:42:59 GMT"} })
126202024-11-25T19:42:59.977ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126212024-11-25T19:42:59.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126222024-11-25T19:42:59.979ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
126232024-11-25T19:42:59.979ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
126242024-11-25T19:42:59.984ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = ChainSuccessorSaga
126252024-11-25T19:42:59.984ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = ChainSuccessorSaga
126262024-11-25T19:42:59.986ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = ChainSuccessorSaga
126272024-11-25T19:42:59.986ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = ChainSuccessorSaga
126282024-11-25T19:43:00.022ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = ChainSuccessorSaga
126292024-11-25T19:43:00.022ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = ChainSuccessorSaga
126302024-11-25T19:43:00.023ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = ChainSuccessorSaga
126312024-11-25T19:43:00.026ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
126322024-11-25T19:43:00.026ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
126332024-11-25T19:43:00.026ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6850ef22-7506-4ef9-8365-5d014aa5d062", "date": "Mon, 25 Nov 2024 19:42:59 GMT"} })
126342024-11-25T19:43:00.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126352024-11-25T19:43:00.026ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b0ee39e3-ee2b-42ea-a096-0949e0c7b88f, lookup_type: ById(b0ee39e3-ee2b-42ea-a096-0949e0c7b88f) }, key: b9902981-e922-4cfe-9602-2068a262a7ba, lookup_type: ById(b9902981-e922-4cfe-9602-2068a262a7ba) } result = Ok(()) saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = ChainSuccessorSaga
126362024-11-25T19:43:00.026ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = ChainSuccessorSaga
126372024-11-25T19:43:00.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126382024-11-25T19:43:00.026ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_node = ChainSuccessorSaga
126392024-11-25T19:43:00.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126402024-11-25T19:43:00.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126412024-11-25T19:43:00.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126422024-11-25T19:43:00.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126432024-11-25T19:43:00.032ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = b9902981-e922-4cfe-9602-2068a262a7ba karmic_state = WillReincarnate needs_reincarnation = false saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update
126442024-11-25T19:43:00.032ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
126452024-11-25T19:43:00.032ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
126462024-11-25T19:43:00.035ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
126472024-11-25T19:43:00.035ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
126482024-11-25T19:43:00.036ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cfb8a8d8-97d2-4910-bb30-9240e42b1083", "date": "Mon, 25 Nov 2024 19:43:00 GMT"} })
126492024-11-25T19:43:00.037ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 163.195212ms iteration = 25 status = {}
126502024-11-25T19:43:00.037ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126512024-11-25T19:43:00.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126522024-11-25T19:43:00.037ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
126532024-11-25T19:43:00.037ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
126542024-11-25T19:43:00.042ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
126552024-11-25T19:43:00.042ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
126562024-11-25T19:43:00.047ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
126572024-11-25T19:43:00.047ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70
126582024-11-25T19:43:00.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126592024-11-25T19:43:00.068ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
126602024-11-25T19:43:00.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126612024-11-25T19:43:00.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126622024-11-25T19:43:00.069ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126632024-11-25T19:43:00.071ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
126642024-11-25T19:43:00.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126652024-11-25T19:43:00.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126662024-11-25T19:43:00.087ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
126672024-11-25T19:43:00.087ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 saga_name = instance-update saga_result = SagaResult { saga_id: dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70, saga_log: SagaLog { saga_id: dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("a4d7f8e5-d349-4dda-973b-2e57165e026c")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a4d7f8e5-d349-4dda-973b-2e57165e026c")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("b9902981-e922-4cfe-9602-2068a262a7ba"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("40644ff1-5ecb-4152-92fd-205456a7f844")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("b9902981-e922-4cfe-9602-2068a262a7ba"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("40644ff1-5ecb-4152-92fd-205456a7f844")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("a4d7f8e5-d349-4dda-973b-2e57165e026c"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("a4d7f8e5-d349-4dda-973b-2e57165e026c")}} }) }
126682024-11-25T19:43:00.087ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = dc34e4bb-2dbb-4e1a-bb2e-945d14c06a70 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update
126692024-11-25T19:43:00.087ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
126702024-11-25T19:43:00.087ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a
126712024-11-25T19:43:00.092ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
126722024-11-25T19:43:00.092ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a
126732024-11-25T19:43:00.094ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
126742024-11-25T19:43:00.094ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a
126752024-11-25T19:43:00.098ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
126762024-11-25T19:43:00.098ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a
126772024-11-25T19:43:00.105ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
126782024-11-25T19:43:00.105ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update sec_id = 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
126792024-11-25T19:43:00.105ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1d890e5-a239-4386-ba29-d9f069371bad", "content-length": "691", "date": "Mon, 25 Nov 2024 19:43:00 GMT"} })
126802024-11-25T19:43:00.105ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = f039b29a-5b6c-43ae-b071-fdb526b9925a saga_name = start-instance-update saga_result = SagaResult { saga_id: f039b29a-5b6c-43ae-b071-fdb526b9925a, saga_log: SagaLog { saga_id: f039b29a-5b6c-43ae-b071-fdb526b9925a, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("9d473148-1912-46a9-ae6d-f53d4926c7ff")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("9d473148-1912-46a9-ae6d-f53d4926c7ff")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("9d473148-1912-46a9-ae6d-f53d4926c7ff"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("9d473148-1912-46a9-ae6d-f53d4926c7ff")}} }) }
126812024-11-25T19:43:00.105ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
126822024-11-25T19:43:00.105ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
126832024-11-25T19:43:00.105ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
126842024-11-25T19:43:00.107ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 233.260016ms iteration = 25 status = {}
126852024-11-25T19:43:00.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad689f26-a959-4973-8498-7e21090ad53e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
126862024-11-25T19:43:00.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad689f26-a959-4973-8498-7e21090ad53e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
126872024-11-25T19:43:00.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ad689f26-a959-4973-8498-7e21090ad53e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
126882024-11-25T19:43:01.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 28efa806-2caf-4516-b499-3e4583dc99ed roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
126892024-11-25T19:43:01.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 28efa806-2caf-4516-b499-3e4583dc99ed resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
126902024-11-25T19:43:01.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 28efa806-2caf-4516-b499-3e4583dc99ed response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
126912024-11-25T19:43:01.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 65173174-dc72-4352-a660-ab11d9520400 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
126922024-11-25T19:43:01.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 65173174-dc72-4352-a660-ab11d9520400 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
126932024-11-25T19:43:01.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = 65173174-dc72-4352-a660-ab11d9520400 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
126942024-11-25T19:43:02.288ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 777 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 17a3eb7c-fbc3-448a-afdb-aec96c3e9ba7 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
126952024-11-25T19:43:02.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fa553d96-92da-40b5-a3c0-5c8ff9750fa8 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
126962024-11-25T19:43:02.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fa553d96-92da-40b5-a3c0-5c8ff9750fa8 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
126972024-11-25T19:43:02.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fa553d96-92da-40b5-a3c0-5c8ff9750fa8 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
126982024-11-25T19:43:03.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dfd117a9-3549-407d-b849-483fc14e6739 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
126992024-11-25T19:43:03.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dfd117a9-3549-407d-b849-483fc14e6739 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127002024-11-25T19:43:03.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dfd117a9-3549-407d-b849-483fc14e6739 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127012024-11-25T19:43:04.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9bc67421-b01d-47a6-ab7f-18ebde429ee4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127022024-11-25T19:43:04.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9bc67421-b01d-47a6-ab7f-18ebde429ee4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127032024-11-25T19:43:04.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 9bc67421-b01d-47a6-ab7f-18ebde429ee4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127042024-11-25T19:43:05.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e19185aa-b3ee-41d2-bec6-7c18052bd0f9 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127052024-11-25T19:43:05.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e19185aa-b3ee-41d2-bec6-7c18052bd0f9 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127062024-11-25T19:43:05.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = e19185aa-b3ee-41d2-bec6-7c18052bd0f9 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127072024-11-25T19:43:06.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a8982043-d41b-49ac-b8be-da378de38fd9 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127082024-11-25T19:43:06.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a8982043-d41b-49ac-b8be-da378de38fd9 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127092024-11-25T19:43:06.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a8982043-d41b-49ac-b8be-da378de38fd9 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127102024-11-25T19:43:06.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
127112024-11-25T19:43:06.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
127122024-11-25T19:43:06.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127132024-11-25T19:43:06.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127142024-11-25T19:43:06.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127152024-11-25T19:43:06.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127162024-11-25T19:43:06.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127172024-11-25T19:43:06.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127182024-11-25T19:43:06.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127192024-11-25T19:43:06.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.3289ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
127202024-11-25T19:43:06.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127212024-11-25T19:43:06.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127222024-11-25T19:43:06.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127232024-11-25T19:43:06.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127242024-11-25T19:43:06.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127252024-11-25T19:43:06.927ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127262024-11-25T19:43:06.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
127272024-11-25T19:43:06.929ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127282024-11-25T19:43:06.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127292024-11-25T19:43:06.942ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
127302024-11-25T19:43:06.942ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.545757ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
127312024-11-25T19:43:07.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 79e5c3a9-d1dc-44a9-95f1-9b0df9a3892e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127322024-11-25T19:43:07.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 79e5c3a9-d1dc-44a9-95f1-9b0df9a3892e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127332024-11-25T19:43:07.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 79e5c3a9-d1dc-44a9-95f1-9b0df9a3892e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127342024-11-25T19:43:08.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dfdd7a9d-3079-4bcd-8aad-15ae6d317b59 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127352024-11-25T19:43:08.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dfdd7a9d-3079-4bcd-8aad-15ae6d317b59 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127362024-11-25T19:43:08.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = dfdd7a9d-3079-4bcd-8aad-15ae6d317b59 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127372024-11-25T19:43:09.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c1848dab-c8b7-46de-8df0-dbfdc638443d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127382024-11-25T19:43:09.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c1848dab-c8b7-46de-8df0-dbfdc638443d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127392024-11-25T19:43:09.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = c1848dab-c8b7-46de-8df0-dbfdc638443d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127402024-11-25T19:43:10.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d6c879f2-3f7b-4da5-a5a5-10e260d35c36 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127412024-11-25T19:43:10.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d6c879f2-3f7b-4da5-a5a5-10e260d35c36 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127422024-11-25T19:43:10.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = d6c879f2-3f7b-4da5-a5a5-10e260d35c36 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127432024-11-25T19:43:11.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 424cf361-cf69-4dbf-9b16-303b530913e9 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127442024-11-25T19:43:11.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 424cf361-cf69-4dbf-9b16-303b530913e9 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127452024-11-25T19:43:11.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 424cf361-cf69-4dbf-9b16-303b530913e9 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127462024-11-25T19:43:12.288ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 607 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = b044b874-8dc4-457a-9dd6-a11870c16725 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
127472024-11-25T19:43:12.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ae95a47f-cf50-4d7c-9ea4-692738362316 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127482024-11-25T19:43:12.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ae95a47f-cf50-4d7c-9ea4-692738362316 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127492024-11-25T19:43:12.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ae95a47f-cf50-4d7c-9ea4-692738362316 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127502024-11-25T19:43:13.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 776a3ebd-4eff-4515-8e82-43c34bb67a09 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127512024-11-25T19:43:13.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 776a3ebd-4eff-4515-8e82-43c34bb67a09 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127522024-11-25T19:43:13.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 776a3ebd-4eff-4515-8e82-43c34bb67a09 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127532024-11-25T19:43:14.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8d413aba-e338-4312-8220-1e70d06e0807 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127542024-11-25T19:43:14.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8d413aba-e338-4312-8220-1e70d06e0807 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127552024-11-25T19:43:14.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2676 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8d413aba-e338-4312-8220-1e70d06e0807 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127562024-11-25T19:43:15.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 22badd17-efc4-44dc-a125-4b1bdaeb0056 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127572024-11-25T19:43:15.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 22badd17-efc4-44dc-a125-4b1bdaeb0056 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127582024-11-25T19:43:15.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 22badd17-efc4-44dc-a125-4b1bdaeb0056 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
127592024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
127602024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
127612024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
127622024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
127632024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
127642024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127652024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
127662024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
127672024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127682024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127692024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
127702024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
127712024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
127722024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
127732024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
127742024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
127752024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
127762024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
127772024-11-25T19:43:16.851ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
127782024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127792024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127802024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
127812024-11-25T19:43:16.851ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
127822024-11-25T19:43:16.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
127832024-11-25T19:43:16.852ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
127842024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
127852024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
127862024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.45\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
127872024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
127882024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127892024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
127902024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
127912024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
127922024-11-25T19:43:16.852ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:33:16.851900673 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
127932024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
127942024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
127952024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
127962024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
127972024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
127982024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
127992024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
128002024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
128012024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
128022024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
128032024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
128042024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
128052024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
128062024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
128072024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
128082024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
128092024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
128102024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128112024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
128122024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
128132024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
128142024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
128152024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128162024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
128172024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
128182024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
128192024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128202024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
128212024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
128222024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
128232024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
128242024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
128252024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128262024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128272024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128282024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
128292024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
128302024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
128312024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
128322024-11-25T19:43:16.852ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1822, tv_nsec: 395567537 } })
128332024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
128342024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
128352024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128362024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128372024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128382024-11-25T19:43:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
128392024-11-25T19:43:16.852ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1822, tv_nsec: 395646788 } })
128402024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
128412024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128422024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
128432024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
128442024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
128452024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
128462024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128472024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128482024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128492024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
128502024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
128512024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128522024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128532024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128542024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128552024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
128562024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.173392ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
128572024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128582024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128592024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
128602024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.765844ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
128612024-11-25T19:43:16.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128622024-11-25T19:43:16.855ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1822, tv_nsec: 398468754 } })
128632024-11-25T19:43:16.855ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
128642024-11-25T19:43:16.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128652024-11-25T19:43:16.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
128662024-11-25T19:43:16.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
128672024-11-25T19:43:16.856ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.638671ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
128682024-11-25T19:43:16.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128692024-11-25T19:43:16.857ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1822, tv_nsec: 400741839 } })
128702024-11-25T19:43:16.858ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
128712024-11-25T19:43:16.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
128722024-11-25T19:43:16.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128732024-11-25T19:43:16.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128742024-11-25T19:43:16.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
128752024-11-25T19:43:16.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128762024-11-25T19:43:16.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128772024-11-25T19:43:16.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
128782024-11-25T19:43:16.860ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:33:16.851900673 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
128792024-11-25T19:43:16.860ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.081498ms iteration = 13 status = {"expiration":"2024-11-25T19:33:16.851900673Z","pruned":[]}
128802024-11-25T19:43:16.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
128812024-11-25T19:43:16.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128822024-11-25T19:43:16.863ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128832024-11-25T19:43:16.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128842024-11-25T19:43:16.865ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.169628ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
128852024-11-25T19:43:16.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
128862024-11-25T19:43:16.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128872024-11-25T19:43:16.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128882024-11-25T19:43:16.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
128892024-11-25T19:43:16.866ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128902024-11-25T19:43:16.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128912024-11-25T19:43:16.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
128922024-11-25T19:43:16.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128932024-11-25T19:43:16.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128942024-11-25T19:43:16.872ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128952024-11-25T19:43:16.875ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
128962024-11-25T19:43:16.875ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128972024-11-25T19:43:16.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128982024-11-25T19:43:16.877ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128992024-11-25T19:43:16.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
129002024-11-25T19:43:16.879ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129012024-11-25T19:43:16.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129022024-11-25T19:43:16.881ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129032024-11-25T19:43:16.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fc562a94-670c-496b-9a0d-2e8cd364122b roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
129042024-11-25T19:43:16.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fc562a94-670c-496b-9a0d-2e8cd364122b resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
129052024-11-25T19:43:16.884ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129062024-11-25T19:43:16.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129072024-11-25T19:43:16.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
129082024-11-25T19:43:16.885ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129092024-11-25T19:43:16.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129102024-11-25T19:43:16.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129112024-11-25T19:43:16.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129122024-11-25T19:43:16.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129132024-11-25T19:43:16.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.156874ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
129142024-11-25T19:43:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
129152024-11-25T19:43:16.906ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129162024-11-25T19:43:16.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129172024-11-25T19:43:16.907ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
129182024-11-25T19:43:16.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129192024-11-25T19:43:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
129202024-11-25T19:43:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129212024-11-25T19:43:16.909ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129222024-11-25T19:43:16.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129232024-11-25T19:43:16.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = fc562a94-670c-496b-9a0d-2e8cd364122b response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
129242024-11-25T19:43:16.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129252024-11-25T19:43:16.914ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
129262024-11-25T19:43:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
129272024-11-25T19:43:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
129282024-11-25T19:43:16.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129292024-11-25T19:43:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129302024-11-25T19:43:16.917ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129312024-11-25T19:43:16.917ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129322024-11-25T19:43:16.917ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129332024-11-25T19:43:16.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 66.948314ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
129342024-11-25T19:43:16.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.79666ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
129352024-11-25T19:43:16.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
129362024-11-25T19:43:16.920ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129372024-11-25T19:43:16.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
129382024-11-25T19:43:16.920ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
129392024-11-25T19:43:16.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129402024-11-25T19:43:16.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
129412024-11-25T19:43:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
129422024-11-25T19:43:16.921ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129432024-11-25T19:43:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129442024-11-25T19:43:16.923ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
129452024-11-25T19:43:16.923ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129462024-11-25T19:43:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
129472024-11-25T19:43:16.923ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129482024-11-25T19:43:16.923ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
129492024-11-25T19:43:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
129502024-11-25T19:43:16.925ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129512024-11-25T19:43:16.925ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
129522024-11-25T19:43:16.925ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
129532024-11-25T19:43:16.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
129542024-11-25T19:43:16.925ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
129552024-11-25T19:43:16.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
129562024-11-25T19:43:16.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
129572024-11-25T19:43:16.925ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1822, tv_nsec: 468757413 } })
129582024-11-25T19:43:16.926ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
129592024-11-25T19:43:16.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
129602024-11-25T19:43:16.926ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129612024-11-25T19:43:16.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129622024-11-25T19:43:16.935ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
129632024-11-25T19:43:16.935ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
129642024-11-25T19:43:16.935ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
129652024-11-25T19:43:16.935ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129662024-11-25T19:43:16.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129672024-11-25T19:43:16.936ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
129682024-11-25T19:43:16.936ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
129692024-11-25T19:43:16.936ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 84.496708ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
129702024-11-25T19:43:16.937ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129712024-11-25T19:43:16.939ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129722024-11-25T19:43:16.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129732024-11-25T19:43:16.940ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129742024-11-25T19:43:16.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
129752024-11-25T19:43:16.940ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129762024-11-25T19:43:16.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129772024-11-25T19:43:16.940ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129782024-11-25T19:43:16.942ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
129792024-11-25T19:43:16.942ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.766511ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
129802024-11-25T19:43:16.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
129812024-11-25T19:43:16.942ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129822024-11-25T19:43:16.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129832024-11-25T19:43:16.944ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129842024-11-25T19:43:16.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
129852024-11-25T19:43:16.944ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129862024-11-25T19:43:16.946ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
129872024-11-25T19:43:16.946ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
129882024-11-25T19:43:16.946ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129892024-11-25T19:43:16.946ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129902024-11-25T19:43:16.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129912024-11-25T19:43:16.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129922024-11-25T19:43:16.949ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 97.168736ms iteration = 6 status = {"nsuccess":5}
129932024-11-25T19:43:16.949ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129942024-11-25T19:43:16.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129952024-11-25T19:43:16.952ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129962024-11-25T19:43:16.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129972024-11-25T19:43:16.954ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129982024-11-25T19:43:16.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
129992024-11-25T19:43:16.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
130002024-11-25T19:43:16.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
130012024-11-25T19:43:16.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130022024-11-25T19:43:16.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130032024-11-25T19:43:16.959ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 107.431737ms iteration = 25 status = 0
130042024-11-25T19:43:16.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 111.363775ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
130052024-11-25T19:43:16.964ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
130062024-11-25T19:43:16.964ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
130072024-11-25T19:43:16.964ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 112.367814ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
130082024-11-25T19:43:16.964ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 112.16291ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
130092024-11-25T19:43:16.964ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 112.830383ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
130102024-11-25T19:43:16.965ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
130112024-11-25T19:43:16.965ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
130122024-11-25T19:43:16.965ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
130132024-11-25T19:43:16.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
130142024-11-25T19:43:16.976ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
130152024-11-25T19:43:16.976ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
130162024-11-25T19:43:16.976ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
130172024-11-25T19:43:16.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130182024-11-25T19:43:16.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130192024-11-25T19:43:16.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130202024-11-25T19:43:16.979ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130212024-11-25T19:43:16.983ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
130222024-11-25T19:43:16.983ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 130.184004ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
130232024-11-25T19:43:16.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
130242024-11-25T19:43:16.983ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130252024-11-25T19:43:16.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130262024-11-25T19:43:16.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
130272024-11-25T19:43:16.983ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130282024-11-25T19:43:16.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130292024-11-25T19:43:16.999ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
130302024-11-25T19:43:17.000ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
130312024-11-25T19:43:17.000ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 148.060915ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
130322024-11-25T19:43:17.003ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
130332024-11-25T19:43:17.003ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 151.734217ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
130342024-11-25T19:43:17.009ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
130352024-11-25T19:43:17.009ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
130362024-11-25T19:43:17.009ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 157.056162ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
130372024-11-25T19:43:17.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130382024-11-25T19:43:17.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130392024-11-25T19:43:17.020ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
130402024-11-25T19:43:17.021ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
130412024-11-25T19:43:17.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130422024-11-25T19:43:17.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130432024-11-25T19:43:17.029ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
130442024-11-25T19:43:17.029ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
130452024-11-25T19:43:17.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130462024-11-25T19:43:17.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130472024-11-25T19:43:17.038ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 186.871386ms iteration = 28 status = {"physical_disks_added":0}
130482024-11-25T19:43:17.055ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130492024-11-25T19:43:17.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
130502024-11-25T19:43:17.058ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130512024-11-25T19:43:17.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130522024-11-25T19:43:17.095ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
130532024-11-25T19:43:17.095ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
130542024-11-25T19:43:17.095ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb325929-5129-4e44-82fe-d4a46ea6fd47", "content-length": "26", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
130552024-11-25T19:43:17.095ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
130562024-11-25T19:43:17.098ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
130572024-11-25T19:43:17.133ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130582024-11-25T19:43:17.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130592024-11-25T19:43:17.145ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
130602024-11-25T19:43:17.165ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
130612024-11-25T19:43:17.165ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
130622024-11-25T19:43:17.165ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e7dc6ad-d219-4bce-a902-15aaabcb71af", "content-length": "26", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
130632024-11-25T19:43:17.165ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
130642024-11-25T19:43:17.167ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
130652024-11-25T19:43:17.190ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
130662024-11-25T19:43:17.190ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
130672024-11-25T19:43:17.191ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0518009c-b087-48d2-9ac8-a717c891cc87", "content-length": "26", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
130682024-11-25T19:43:17.191ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
130692024-11-25T19:43:17.193ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
130702024-11-25T19:43:17.195ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
130712024-11-25T19:43:17.195ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
130722024-11-25T19:43:17.195ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
130732024-11-25T19:43:17.195ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "37f7443f-e424-4e23-b904-c5a11816a340", "content-length": "372", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
130742024-11-25T19:43:17.195ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130752024-11-25T19:43:17.195ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "962b20b3-b544-44dd-8533-3708c0b7109a", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
130762024-11-25T19:43:17.195ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
130772024-11-25T19:43:17.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130782024-11-25T19:43:17.197ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d1c99168-042b-43b4-9ea2-9636a385d4f5", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
130792024-11-25T19:43:17.197ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
130802024-11-25T19:43:17.197ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130812024-11-25T19:43:17.198ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
130822024-11-25T19:43:17.198ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
130832024-11-25T19:43:17.198ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
130842024-11-25T19:43:17.198ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 346.650711ms iteration = 13 status = {"generation":2}
130852024-11-25T19:43:17.199ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
130862024-11-25T19:43:17.199ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 346.992348ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
130872024-11-25T19:43:17.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
130882024-11-25T19:43:17.200ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130892024-11-25T19:43:17.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130902024-11-25T19:43:17.203ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
130912024-11-25T19:43:17.203ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
130922024-11-25T19:43:17.203ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
130932024-11-25T19:43:17.203ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 351.71729ms iteration = 13 status = {"generation":1}
130942024-11-25T19:43:17.235ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130952024-11-25T19:43:17.237ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
130962024-11-25T19:43:17.237ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130972024-11-25T19:43:17.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130982024-11-25T19:43:17.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130992024-11-25T19:43:17.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
131002024-11-25T19:43:17.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131012024-11-25T19:43:17.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131022024-11-25T19:43:17.252ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
131032024-11-25T19:43:17.252ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
131042024-11-25T19:43:17.253ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "86b307ec-d4fe-4334-a090-126317ee0b1e", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
131052024-11-25T19:43:17.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131062024-11-25T19:43:17.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131072024-11-25T19:43:17.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131082024-11-25T19:43:17.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131092024-11-25T19:43:17.264ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 412.80744ms iteration = 25 status = {}
131102024-11-25T19:43:17.377ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
131112024-11-25T19:43:17.436ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
131122024-11-25T19:43:17.436ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "31dd7687-579b-40e6-9f39-4f139514fe48", "content-length": "2", "date": "Mon, 25 Nov 2024 19:43:17 GMT"} })
131132024-11-25T19:43:17.438ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
131142024-11-25T19:43:17.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
131152024-11-25T19:43:17.499ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
131162024-11-25T19:43:17.499ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "502f2ecf-95e9-4c5b-9874-5d239316f68a", "content-length": "691", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
131172024-11-25T19:43:17.499ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
131182024-11-25T19:43:17.499ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
131192024-11-25T19:43:17.499ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
131202024-11-25T19:43:17.501ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 649.784019ms iteration = 25 status = null
131212024-11-25T19:43:17.502ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131222024-11-25T19:43:17.502ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 650.36ms iteration = 26 status = {}
131232024-11-25T19:43:17.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131242024-11-25T19:43:17.506ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
131252024-11-25T19:43:17.506ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
131262024-11-25T19:43:17.506ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e0f27cd7-893e-49f8-8d61-d898284491ce", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
131272024-11-25T19:43:17.507ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 655.994131ms iteration = 26 status = {}
131282024-11-25T19:43:17.526ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
131292024-11-25T19:43:17.526ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0dbeee9c-4ec7-4992-8d6b-6a802ae33f8f", "date": "Mon, 25 Nov 2024 19:43:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
131302024-11-25T19:43:17.526ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
131312024-11-25T19:43:17.528ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "00876295-004e-43f0-8789-3f9d4faeb8ba", "date": "Mon, 25 Nov 2024 19:43:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
131322024-11-25T19:43:17.528ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
131332024-11-25T19:43:17.530ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1f0a8281-e6bd-423b-802a-b103f3a96758", "date": "Mon, 25 Nov 2024 19:43:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
131342024-11-25T19:43:17.530ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
131352024-11-25T19:43:17.532ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
131362024-11-25T19:43:17.532ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 680.846388ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
131372024-11-25T19:43:17.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131382024-11-25T19:43:17.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131392024-11-25T19:43:17.553ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
131402024-11-25T19:43:17.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131412024-11-25T19:43:17.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131422024-11-25T19:43:17.561ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
131432024-11-25T19:43:17.562ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ad18461-415f-40f5-a29d-280da64086db", "content-length": "134", "date": "Mon, 25 Nov 2024 19:43:17 GMT"} })
131442024-11-25T19:43:17.562ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
131452024-11-25T19:43:17.562ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
131462024-11-25T19:43:17.562ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
131472024-11-25T19:43:17.562ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
131482024-11-25T19:43:17.562ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131492024-11-25T19:43:17.562ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131502024-11-25T19:43:17.562ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131512024-11-25T19:43:17.562ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
131522024-11-25T19:43:17.562ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131532024-11-25T19:43:17.562ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
131542024-11-25T19:43:17.562ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
131552024-11-25T19:43:17.562ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131562024-11-25T19:43:17.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131572024-11-25T19:43:17.564ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
131582024-11-25T19:43:17.564ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "abff7256-20af-44c4-95bb-272bc8bfeaf7", "content-length": "2", "date": "Mon, 25 Nov 2024 19:43:17 GMT"} })
131592024-11-25T19:43:17.564ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
131602024-11-25T19:43:17.564ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c8ec224-481f-48da-b634-129693bfc091", "content-length": "51", "date": "Mon, 25 Nov 2024 19:43:17 GMT"} })
131612024-11-25T19:43:17.564ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
131622024-11-25T19:43:17.564ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
131632024-11-25T19:43:17.659ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6788d501-8ff0-45c6-9d0a-4cdcaafd1608", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
131642024-11-25T19:43:17.659ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
131652024-11-25T19:43:17.659ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
131662024-11-25T19:43:17.660ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "47209fd3-a96e-4f7a-9434-89efb13a4e88", "content-length": "682", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
131672024-11-25T19:43:17.660ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131682024-11-25T19:43:17.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131692024-11-25T19:43:17.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131702024-11-25T19:43:17.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131712024-11-25T19:43:17.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131722024-11-25T19:43:17.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131732024-11-25T19:43:17.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131742024-11-25T19:43:17.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131752024-11-25T19:43:17.677ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 825.17676ms iteration = 25 status = {}
131762024-11-25T19:43:17.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8d9adaa8-ba7a-4606-8c64-38c6d402cabf roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131772024-11-25T19:43:17.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8d9adaa8-ba7a-4606-8c64-38c6d402cabf resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131782024-11-25T19:43:17.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8d9adaa8-ba7a-4606-8c64-38c6d402cabf response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131792024-11-25T19:43:18.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 32a36d25-be11-4665-a4ab-f01f03044bfe roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131802024-11-25T19:43:18.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 32a36d25-be11-4665-a4ab-f01f03044bfe resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131812024-11-25T19:43:18.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 32a36d25-be11-4665-a4ab-f01f03044bfe response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131822024-11-25T19:43:19.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0dc5a567-a589-4ce8-88c1-9a9c0289f8f9 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131832024-11-25T19:43:19.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0dc5a567-a589-4ce8-88c1-9a9c0289f8f9 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131842024-11-25T19:43:19.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0dc5a567-a589-4ce8-88c1-9a9c0289f8f9 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131852024-11-25T19:43:20.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cf6722b2-7f10-4ba8-af1c-f826f671b080 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131862024-11-25T19:43:20.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cf6722b2-7f10-4ba8-af1c-f826f671b080 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131872024-11-25T19:43:21.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = cf6722b2-7f10-4ba8-af1c-f826f671b080 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131882024-11-25T19:43:22.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ecbff49c-38cc-4acc-a96a-a772d83f2d9f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131892024-11-25T19:43:22.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ecbff49c-38cc-4acc-a96a-a772d83f2d9f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131902024-11-25T19:43:22.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ecbff49c-38cc-4acc-a96a-a772d83f2d9f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131912024-11-25T19:43:22.288ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 525 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 0bda3a0e-ae36-4ce0-a1a1-85993d932d09 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
131922024-11-25T19:43:23.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a00b45bd-55eb-4cf9-af36-e59ab7a2266f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131932024-11-25T19:43:23.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a00b45bd-55eb-4cf9-af36-e59ab7a2266f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131942024-11-25T19:43:23.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = a00b45bd-55eb-4cf9-af36-e59ab7a2266f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131952024-11-25T19:43:24.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 95ff9568-d74a-4a08-97a2-59195bb20a0e roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131962024-11-25T19:43:24.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 95ff9568-d74a-4a08-97a2-59195bb20a0e resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131972024-11-25T19:43:24.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 95ff9568-d74a-4a08-97a2-59195bb20a0e response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131982024-11-25T19:43:25.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8541f51f-dfb9-4181-b734-0a3b123ccf44 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
131992024-11-25T19:43:25.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8541f51f-dfb9-4181-b734-0a3b123ccf44 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132002024-11-25T19:43:25.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8541f51f-dfb9-4181-b734-0a3b123ccf44 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132012024-11-25T19:43:26.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 65342a63-8854-4f53-bfc4-2ae4793d499d roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132022024-11-25T19:43:26.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 65342a63-8854-4f53-bfc4-2ae4793d499d resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132032024-11-25T19:43:26.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 65342a63-8854-4f53-bfc4-2ae4793d499d response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132042024-11-25T19:43:26.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
132052024-11-25T19:43:26.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
132062024-11-25T19:43:26.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132072024-11-25T19:43:26.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132082024-11-25T19:43:26.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132092024-11-25T19:43:26.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132102024-11-25T19:43:26.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132112024-11-25T19:43:26.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132122024-11-25T19:43:26.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132132024-11-25T19:43:26.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132142024-11-25T19:43:26.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132152024-11-25T19:43:26.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132162024-11-25T19:43:26.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132172024-11-25T19:43:26.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132182024-11-25T19:43:26.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132192024-11-25T19:43:26.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
132202024-11-25T19:43:26.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132212024-11-25T19:43:26.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132222024-11-25T19:43:26.901ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
132232024-11-25T19:43:26.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.611153ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
132242024-11-25T19:43:26.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.732453ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
132252024-11-25T19:43:27.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1e5624c5-3f32-48b0-b11d-bebae8de3bdf roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132262024-11-25T19:43:27.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1e5624c5-3f32-48b0-b11d-bebae8de3bdf resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132272024-11-25T19:43:27.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1e5624c5-3f32-48b0-b11d-bebae8de3bdf response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132282024-11-25T19:43:28.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8c8bbe3e-b83b-4dcf-a3e6-2bc79c66be31 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132292024-11-25T19:43:28.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8c8bbe3e-b83b-4dcf-a3e6-2bc79c66be31 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132302024-11-25T19:43:28.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8c8bbe3e-b83b-4dcf-a3e6-2bc79c66be31 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132312024-11-25T19:43:29.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7338c3ed-7f0d-4073-8f6b-6a6740c9fd0c roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132322024-11-25T19:43:29.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7338c3ed-7f0d-4073-8f6b-6a6740c9fd0c resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132332024-11-25T19:43:29.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 7338c3ed-7f0d-4073-8f6b-6a6740c9fd0c response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132342024-11-25T19:43:30.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bf53ce81-e3ab-42f7-a298-20dcfc18bcdd roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132352024-11-25T19:43:30.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bf53ce81-e3ab-42f7-a298-20dcfc18bcdd resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132362024-11-25T19:43:30.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = bf53ce81-e3ab-42f7-a298-20dcfc18bcdd response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132372024-11-25T19:43:31.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ed0d8ed2-a261-49d8-955b-b6a27f6b96ab roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132382024-11-25T19:43:31.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ed0d8ed2-a261-49d8-955b-b6a27f6b96ab resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132392024-11-25T19:43:31.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = ed0d8ed2-a261-49d8-955b-b6a27f6b96ab response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132402024-11-25T19:43:31.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = c6b24ff6-7ea5-4879-b870-51764787f862 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
132412024-11-25T19:43:31.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = c6b24ff6-7ea5-4879-b870-51764787f862 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
132422024-11-25T19:43:31.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56312 req_id = c6b24ff6-7ea5-4879-b870-51764787f862 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
132432024-11-25T19:43:32.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0b4ddf78-eedc-44ed-a9fe-d53a77e05d24 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132442024-11-25T19:43:32.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0b4ddf78-eedc-44ed-a9fe-d53a77e05d24 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132452024-11-25T19:43:32.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 0b4ddf78-eedc-44ed-a9fe-d53a77e05d24 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132462024-11-25T19:43:32.288ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 592 local_addr = [fd00:1122:3344:101::c]:46244 method = GET remote_addr = [fd00:1122:3344:101::d]:63859 req_id = 674c2a94-c002-4c7e-ac40-ec2a78a3c383 response_code = 200 uri = /29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037
132472024-11-25T19:43:33.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4016dd5e-4b67-4f9e-b1ff-c3c801f80997 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132482024-11-25T19:43:33.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4016dd5e-4b67-4f9e-b1ff-c3c801f80997 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132492024-11-25T19:43:33.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 4016dd5e-4b67-4f9e-b1ff-c3c801f80997 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132502024-11-25T19:43:34.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 30b443f4-599a-4792-8558-7556f69ef88f roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132512024-11-25T19:43:34.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 30b443f4-599a-4792-8558-7556f69ef88f resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132522024-11-25T19:43:34.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 30b443f4-599a-4792-8558-7556f69ef88f response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132532024-11-25T19:43:35.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 868f2561-afb4-4b40-b386-d69a92159876 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132542024-11-25T19:43:35.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 868f2561-afb4-4b40-b386-d69a92159876 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132552024-11-25T19:43:35.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 868f2561-afb4-4b40-b386-d69a92159876 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132562024-11-25T19:43:36.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 48e0501f-1af7-4dd6-82cd-0136563a0194 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132572024-11-25T19:43:36.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 48e0501f-1af7-4dd6-82cd-0136563a0194 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132582024-11-25T19:43:36.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 48e0501f-1af7-4dd6-82cd-0136563a0194 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132592024-11-25T19:43:36.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
132602024-11-25T19:43:36.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
132612024-11-25T19:43:36.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132622024-11-25T19:43:36.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132632024-11-25T19:43:36.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132642024-11-25T19:43:36.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132652024-11-25T19:43:36.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132662024-11-25T19:43:36.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132672024-11-25T19:43:36.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132682024-11-25T19:43:36.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132692024-11-25T19:43:36.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132702024-11-25T19:43:36.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132712024-11-25T19:43:36.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132722024-11-25T19:43:36.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132732024-11-25T19:43:36.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132742024-11-25T19:43:36.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
132752024-11-25T19:43:36.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132762024-11-25T19:43:36.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132772024-11-25T19:43:36.876ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
132782024-11-25T19:43:36.876ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.158254ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
132792024-11-25T19:43:36.885ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.539668ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
132802024-11-25T19:43:37.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 796643e6-a1be-4047-acef-9dcb4273680d roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
132812024-11-25T19:43:37.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 796643e6-a1be-4047-acef-9dcb4273680d resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
132822024-11-25T19:43:37.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = 796643e6-a1be-4047-acef-9dcb4273680d response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
132832024-11-25T19:43:37.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = fa9706b7-b10e-41ea-9f5c-432b25cd914a roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
132842024-11-25T19:43:37.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = fa9706b7-b10e-41ea-9f5c-432b25cd914a resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
132852024-11-25T19:43:37.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48601 req_id = fa9706b7-b10e-41ea-9f5c-432b25cd914a response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
132862024-11-25T19:43:37.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 22f0531b-046e-46da-a000-b4a064f476c4 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132872024-11-25T19:43:37.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 22f0531b-046e-46da-a000-b4a064f476c4 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132882024-11-25T19:43:37.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 22f0531b-046e-46da-a000-b4a064f476c4 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132892024-11-25T19:43:38.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1ba659b9-25d7-42fb-8861-2d9024765bad roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132902024-11-25T19:43:38.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1ba659b9-25d7-42fb-8861-2d9024765bad resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132912024-11-25T19:43:38.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 1ba659b9-25d7-42fb-8861-2d9024765bad response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132922024-11-25T19:43:39.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8f04364a-4376-4cb3-977f-893fc7a8f8a2 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132932024-11-25T19:43:39.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8f04364a-4376-4cb3-977f-893fc7a8f8a2 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132942024-11-25T19:43:39.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 8f04364a-4376-4cb3-977f-893fc7a8f8a2 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132952024-11-25T19:43:40.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 647858e0-5f49-478e-9829-05de629f53f2 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132962024-11-25T19:43:40.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 647858e0-5f49-478e-9829-05de629f53f2 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132972024-11-25T19:43:40.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 647858e0-5f49-478e-9829-05de629f53f2 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132982024-11-25T19:43:41.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5f850890-762c-4dfa-a7be-2416bf5173b3 roles = RoleSet { roles: {} } uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
132992024-11-25T19:43:41.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5f850890-762c-4dfa-a7be-2416bf5173b3 resource = Database result = Ok(()) uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b
133002024-11-25T19:43:41.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45206 req_id = 5f850890-762c-4dfa-a7be-2416bf5173b3 response_code = 200 uri = /probes/38711855-ef69-4d79-bb75-aebd85b1280b