Max level shown:
1 [ Oct 1 02:32:40 Enabled. ]
2 [ Oct 1 02:32:40 Rereading configuration. ]
3 [ Oct 1 02:32:43 Rereading configuration. ]
4 [ Oct 1 02:32:57 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Oct 1 02:32:57 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-10-01T02:32:57.626ZDEBGnexus: registered DTrace probes
82024-10-01T02:32:57.628ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:74
92024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
332024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
342024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
352024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
362024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
372024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
382024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
392024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
402024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
412024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
422024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
432024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
442024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
452024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
462024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
472024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
482024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
492024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
502024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
512024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
522024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
532024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
542024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
552024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
562024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
572024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
582024-10-01T02:32:57.636ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
592024-10-01T02:32:57.636ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
602024-10-01T02:32:57.652ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:218
612024-10-01T02:32:57.656ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:72
622024-10-01T02:32:57.660ZINFOnexus (ServerContext): Setting up qorb pool from DNS dns_addrs = [\n [fd00:1122:3344:1::1]:53,\n [fd00:1122:3344:2::1]:53,\n [fd00:1122:3344:3::1]:53,\n [fd00:1122:3344:4::1]:53,\n [fd00:1122:3344:5::1]:53,\n] file = nexus/src/context.rs:267
632024-10-01T02:33:07.780ZINFOnexus: Database schema version is up to date desired_version = 106.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 106.0.0
642024-10-01T02:33:07.782ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
652024-10-01T02:33:07.783ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1241, tv_nsec: 226922258 } })
662024-10-01T02:33:07.783ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1051
672024-10-01T02:33:07.832ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
682024-10-01T02:33:07.833ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
692024-10-01T02:33:07.836ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe9390e4-c43b-47c9-9226-7cae29ee1df3", "content-length": "26", "date": "Tue, 01 Oct 2024 02:33:07 GMT"} })
702024-10-01T02:33:07.836ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
712024-10-01T02:33:07.837ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
722024-10-01T02:33:07.868ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1241, tv_nsec: 311918912 } })
732024-10-01T02:33:07.868ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1051
742024-10-01T02:33:07.902ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
752024-10-01T02:33:07.902ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
762024-10-01T02:33:07.903ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "573f1280-4b40-455b-af55-6f3868757884", "content-length": "26", "date": "Tue, 01 Oct 2024 02:33:07 GMT"} })
772024-10-01T02:33:07.903ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
782024-10-01T02:33:07.903ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
792024-10-01T02:33:07.980ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
802024-10-01T02:33:07.988ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
812024-10-01T02:33:07.989ZDEBGnexus (DataLoader): attempting to create built-in users
822024-10-01T02:33:07.989ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
832024-10-01T02:33:07.989ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
842024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /artifacts/{kind}/{name}/{version}
852024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks
862024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /bgtasks/activate
872024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks/view/{bgtask_name}
882024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request
892024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped
902024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress
912024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish
922024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start
932024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga
942024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete
952024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all
962024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id}
972024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id}
982024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/import
992024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/regenerate
1002024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/target
1012024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/target
1022024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /deployment/blueprints/target/enabled
1032024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent
1042024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /disks/{disk_id}
1052024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /instances/{instance_id}/migrate
1062024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/collectors
1072024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /metrics/collectors/{collector_id}/producers
1082024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/producers
1092024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /nat/ipv4/changeset/{from_gen}
1102024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /physical-disk/expunge
1112024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /probes/{sled}
1122024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /racks/{rack_id}/initialization-complete
1132024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas
1142024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas/{saga_id}
1152024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sled-agents/{sled_id}
1162024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}
1172024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update
1182024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/add
1192024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/expunge
1202024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sleds/uninitialized
1212024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /switch/{switch_id}
1222024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /vmms/{propolis_id}
1232024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent
1242024-10-01T02:33:08.001ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::b]:12221
1252024-10-01T02:33:08.001ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12221
1262024-10-01T02:33:08.002ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1272024-10-01T02:33:08.002ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1282024-10-01T02:33:08.062ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:45092
1292024-10-01T02:33:08.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7e90e9d5-a62a-46cc-923c-c21d6f066059 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
1302024-10-01T02:33:08.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7e90e9d5-a62a-46cc-923c-c21d6f066059 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
1312024-10-01T02:33:08.172ZWARNnexus: Cannot look up rack: Object (of type ById(52547763-7759-42e1-81a9-8b833f59f5dd)) not found: rack file = nexus/src/app/rack.rs:770
1322024-10-01T02:33:08.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7e90e9d5-a62a-46cc-923c-c21d6f066059 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
1332024-10-01T02:33:08.222ZINFOnexus (DataLoader): created 5 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1342024-10-01T02:33:08.222ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1352024-10-01T02:33:08.223ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1362024-10-01T02:33:08.223ZDEBGnexus (DataLoader): attempting to create built-in roles
1372024-10-01T02:33:08.223ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1382024-10-01T02:33:08.223ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1392024-10-01T02:33:08.301ZINFOnexus (DataLoader): created 10 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1402024-10-01T02:33:08.301ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1412024-10-01T02:33:08.302ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1422024-10-01T02:33:08.302ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1432024-10-01T02:33:08.302ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1442024-10-01T02:33:08.303ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1452024-10-01T02:33:09.139ZINFOnexus (DataLoader): created 4 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1462024-10-01T02:33:09.139ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1472024-10-01T02:33:09.141ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1482024-10-01T02:33:09.141ZDEBGnexus (DataLoader): attempting to create built-in silos
1492024-10-01T02:33:09.141ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1502024-10-01T02:33:09.141ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1512024-10-01T02:33:09.226ZINFOnexus (DataLoader): created 2 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1522024-10-01T02:33:09.226ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1532024-10-01T02:33:09.226ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1542024-10-01T02:33:09.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2b623975-faba-45bb-aeb0-48e068552f1f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
1552024-10-01T02:33:09.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2b623975-faba-45bb-aeb0-48e068552f1f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
1562024-10-01T02:33:09.406ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1572024-10-01T02:33:09.407ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1582024-10-01T02:33:09.407ZDEBGnexus (DataLoader): attempting to create built-in projects
1592024-10-01T02:33:09.407ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1602024-10-01T02:33:09.407ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1612024-10-01T02:33:09.415ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1622024-10-01T02:33:09.416ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1632024-10-01T02:33:09.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2b623975-faba-45bb-aeb0-48e068552f1f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
1642024-10-01T02:33:09.442ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1652024-10-01T02:33:09.442ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1662024-10-01T02:33:09.472ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1672024-10-01T02:33:09.474ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1682024-10-01T02:33:09.474ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1692024-10-01T02:33:09.474ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1702024-10-01T02:33:09.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4f8c7028-ada9-428a-9fc1-41ed084e25f3 roles = RoleSet { roles: {} } uri = /sled-agents/2a571ec0-85a3-450e-88fc-680c13ffa211
1712024-10-01T02:33:09.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4f8c7028-ada9-428a-9fc1-41ed084e25f3 resource = Database result = Ok(()) uri = /sled-agents/2a571ec0-85a3-450e-88fc-680c13ffa211
1722024-10-01T02:33:09.581ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "2a571ec0-85a3-450e-88fc-680c13ffa211" error_message_internal = not found: sled with id "2a571ec0-85a3-450e-88fc-680c13ffa211" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 78831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4f8c7028-ada9-428a-9fc1-41ed084e25f3 response_code = 404 uri = /sled-agents/2a571ec0-85a3-450e-88fc-680c13ffa211
1732024-10-01T02:33:10.094ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1742024-10-01T02:33:10.094ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1752024-10-01T02:33:10.164ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1762024-10-01T02:33:10.166ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1772024-10-01T02:33:10.166ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1782024-10-01T02:33:10.166ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1792024-10-01T02:33:10.173ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1802024-10-01T02:33:10.174ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1812024-10-01T02:33:10.175ZWARNnexus: Cannot look up rack: Object (of type ById(52547763-7759-42e1-81a9-8b833f59f5dd)) not found: rack file = nexus/src/app/rack.rs:770
1822024-10-01T02:33:10.197ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1832024-10-01T02:33:10.197ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1842024-10-01T02:33:10.198ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1852024-10-01T02:33:10.198ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1862024-10-01T02:33:10.198ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1872024-10-01T02:33:10.198ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1882024-10-01T02:33:10.213ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1892024-10-01T02:33:10.213ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1902024-10-01T02:33:10.223ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1912024-10-01T02:33:10.224ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1922024-10-01T02:33:10.225ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1932024-10-01T02:33:10.225ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1942024-10-01T02:33:10.226ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1952024-10-01T02:33:10.227ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1962024-10-01T02:33:10.228ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1972024-10-01T02:33:10.231ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1982024-10-01T02:33:10.232ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1992024-10-01T02:33:10.232ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2002024-10-01T02:33:10.233ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2012024-10-01T02:33:10.234ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2022024-10-01T02:33:10.261ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2032024-10-01T02:33:10.262ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2042024-10-01T02:33:10.263ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2052024-10-01T02:33:10.265ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2062024-10-01T02:33:10.265ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2072024-10-01T02:33:10.266ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2082024-10-01T02:33:10.291ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2092024-10-01T02:33:10.291ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2102024-10-01T02:33:10.307ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2112024-10-01T02:33:10.307ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2122024-10-01T02:33:10.309ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2132024-10-01T02:33:10.309ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2142024-10-01T02:33:10.311ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2152024-10-01T02:33:10.311ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2162024-10-01T02:33:10.317ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2172024-10-01T02:33:10.321ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2182024-10-01T02:33:10.321ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2192024-10-01T02:33:10.321ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2202024-10-01T02:33:10.354ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2212024-10-01T02:33:10.355ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2222024-10-01T02:33:10.356ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2232024-10-01T02:33:10.356ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2242024-10-01T02:33:10.358ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2252024-10-01T02:33:10.358ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2262024-10-01T02:33:10.360ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2272024-10-01T02:33:10.363ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2282024-10-01T02:33:10.363ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2292024-10-01T02:33:10.363ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2302024-10-01T02:33:10.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c7c0aa6b-ce20-4e21-a96e-2b6a5a7629e9 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
2312024-10-01T02:33:10.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c7c0aa6b-ce20-4e21-a96e-2b6a5a7629e9 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
2322024-10-01T02:33:10.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 15096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c7c0aa6b-ce20-4e21-a96e-2b6a5a7629e9 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
2332024-10-01T02:33:10.469ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2342024-10-01T02:33:10.469ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2352024-10-01T02:33:10.470ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362024-10-01T02:33:10.470ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2372024-10-01T02:33:10.472ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2382024-10-01T02:33:10.472ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2392024-10-01T02:33:10.473ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2402024-10-01T02:33:10.476ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2412024-10-01T02:33:10.476ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2422024-10-01T02:33:10.476ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2432024-10-01T02:33:10.487ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2442024-10-01T02:33:10.487ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2452024-10-01T02:33:10.487ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2462024-10-01T02:33:10.490ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2472024-10-01T02:33:10.491ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2482024-10-01T02:33:10.492ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2492024-10-01T02:33:10.493ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2502024-10-01T02:33:10.495ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2512024-10-01T02:33:10.495ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2522024-10-01T02:33:10.497ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2532024-10-01T02:33:10.497ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2542024-10-01T02:33:10.499ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2552024-10-01T02:33:10.499ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2562024-10-01T02:33:10.500ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2572024-10-01T02:33:10.502ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2582024-10-01T02:33:10.502ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2592024-10-01T02:33:10.502ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2602024-10-01T02:33:10.504ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2612024-10-01T02:33:10.504ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2622024-10-01T02:33:10.505ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2632024-10-01T02:33:10.505ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2642024-10-01T02:33:10.514ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2652024-10-01T02:33:10.517ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2662024-10-01T02:33:10.517ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2672024-10-01T02:33:10.517ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2682024-10-01T02:33:10.543ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2692024-10-01T02:33:10.544ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2702024-10-01T02:33:10.545ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2712024-10-01T02:33:10.545ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2722024-10-01T02:33:10.546ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2732024-10-01T02:33:10.547ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2742024-10-01T02:33:10.548ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2752024-10-01T02:33:10.550ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2762024-10-01T02:33:10.550ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2772024-10-01T02:33:10.551ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2782024-10-01T02:33:10.665ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:252
2792024-10-01T02:33:10.665ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2802024-10-01T02:33:10.665ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2812024-10-01T02:33:10.666ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2822024-10-01T02:33:10.679ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2832024-10-01T02:33:10.679ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2842024-10-01T02:33:10.680ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2852024-10-01T02:33:10.680ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2862024-10-01T02:33:10.682ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2872024-10-01T02:33:10.682ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2882024-10-01T02:33:10.684ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2892024-10-01T02:33:10.684ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2902024-10-01T02:33:10.685ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2912024-10-01T02:33:10.685ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2922024-10-01T02:33:10.687ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2932024-10-01T02:33:10.690ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2942024-10-01T02:33:10.690ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2952024-10-01T02:33:10.690ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2962024-10-01T02:33:10.700ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2972024-10-01T02:33:10.700ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2982024-10-01T02:33:10.702ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2992024-10-01T02:33:10.702ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3002024-10-01T02:33:10.710ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3012024-10-01T02:33:10.710ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3022024-10-01T02:33:10.711ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3032024-10-01T02:33:10.714ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3042024-10-01T02:33:10.747ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3052024-10-01T02:33:10.747ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3062024-10-01T02:33:10.805ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3072024-10-01T02:33:10.805ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3082024-10-01T02:33:10.822ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3092024-10-01T02:33:10.823ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3102024-10-01T02:33:10.824ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3112024-10-01T02:33:10.824ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3122024-10-01T02:33:10.825ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3132024-10-01T02:33:10.825ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3142024-10-01T02:33:10.827ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3152024-10-01T02:33:10.830ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3162024-10-01T02:33:10.830ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3172024-10-01T02:33:10.830ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3182024-10-01T02:33:10.839ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3192024-10-01T02:33:10.839ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3202024-10-01T02:33:10.842ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3212024-10-01T02:33:10.842ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3222024-10-01T02:33:10.843ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3232024-10-01T02:33:10.843ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3242024-10-01T02:33:10.845ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3252024-10-01T02:33:10.845ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3262024-10-01T02:33:10.846ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3272024-10-01T02:33:10.849ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3282024-10-01T02:33:10.902ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3292024-10-01T02:33:10.902ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3302024-10-01T02:33:11.029ZERROnexus (DataLoader): gave up trying to populate built-in PopulateBuiltinVpcs error_message = InternalError { internal_message: "unexpected database error: Record not found" } file = nexus/src/populate.rs:126
3312024-10-01T02:33:11.029ZERROnexus: populate failed file = nexus/src/app/mod.rs:517
3322024-10-01T02:33:11.029ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:523
3332024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
3342024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
3352024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
3362024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
3372024-10-01T02:33:11.030ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
3382024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
3392024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
3402024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
3412024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
3422024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
3432024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
3442024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
3452024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
3462024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
3472024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
3482024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3492024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3502024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
3512024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3522024-10-01T02:33:11.030ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3532024-10-01T02:33:11.030ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3542024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3552024-10-01T02:33:11.030ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-01 02:23:11.030701072 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
3562024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 137.553\u{b5}s iteration = 1 status = {"error":"no blueprint"}
3572024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3582024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
3592024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
3602024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 127.032\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
3612024-10-01T02:33:11.030ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 62.401\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
3622024-10-01T02:33:11.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3632024-10-01T02:33:11.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3642024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
3652024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
3662024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3672024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
3682024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
3692024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
3702024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
3712024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
3722024-10-01T02:33:11.032ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
3732024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 28.31\u{b5}s iteration = 1 status = {"error":"no blueprint"}
3742024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
3752024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
3762024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
3772024-10-01T02:33:11.032ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
3782024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
3792024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
3802024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
3812024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
3822024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
3832024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
3842024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
3852024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
3862024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
3872024-10-01T02:33:11.032ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3882024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3892024-10-01T02:33:11.033ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
3902024-10-01T02:33:11.033ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
3912024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3922024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3932024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
3942024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
3952024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
3962024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
3972024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
3982024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
3992024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4002024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4012024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4022024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4032024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4042024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4052024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4062024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4072024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4082024-10-01T02:33:11.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4092024-10-01T02:33:11.034ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4102024-10-01T02:33:11.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4112024-10-01T02:33:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4122024-10-01T02:33:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4132024-10-01T02:33:11.034ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4142024-10-01T02:33:11.034ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1244, tv_nsec: 478020026 } })
4152024-10-01T02:33:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4162024-10-01T02:33:11.034ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1244, tv_nsec: 478224050 } })
4172024-10-01T02:33:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4182024-10-01T02:33:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4192024-10-01T02:33:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4202024-10-01T02:33:11.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4212024-10-01T02:33:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4222024-10-01T02:33:11.035ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4232024-10-01T02:33:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4242024-10-01T02:33:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4252024-10-01T02:33:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4262024-10-01T02:33:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4272024-10-01T02:33:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4282024-10-01T02:33:11.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4292024-10-01T02:33:11.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4302024-10-01T02:33:11.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4312024-10-01T02:33:11.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4322024-10-01T02:33:11.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4332024-10-01T02:33:11.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4342024-10-01T02:33:11.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
4352024-10-01T02:33:11.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4362024-10-01T02:33:11.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4372024-10-01T02:33:11.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4382024-10-01T02:33:11.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4392024-10-01T02:33:11.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4402024-10-01T02:33:11.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4412024-10-01T02:33:11.038ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
4422024-10-01T02:33:11.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4432024-10-01T02:33:11.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4442024-10-01T02:33:11.039ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4452024-10-01T02:33:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4462024-10-01T02:33:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
4472024-10-01T02:33:11.040ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4482024-10-01T02:33:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4492024-10-01T02:33:11.041ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4502024-10-01T02:33:11.041ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
4512024-10-01T02:33:11.041ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 10.946563ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4522024-10-01T02:33:11.041ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 10.920843ms iteration = 1 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
4532024-10-01T02:33:11.041ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
4542024-10-01T02:33:11.041ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4552024-10-01T02:33:11.041ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
4562024-10-01T02:33:11.041ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 3.909\u{b5}s iteration = 2 status = {"error":"no config"}
4572024-10-01T02:33:11.041ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4582024-10-01T02:33:11.041ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 5.76\u{b5}s iteration = 2 status = {"error":"no config"}
4592024-10-01T02:33:11.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4602024-10-01T02:33:11.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4612024-10-01T02:33:11.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4622024-10-01T02:33:11.047ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4632024-10-01T02:33:11.050ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4642024-10-01T02:33:11.050ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-01 02:23:11.030701072 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
4652024-10-01T02:33:11.050ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.72734ms iteration = 1 status = {"expiration":"2024-10-01T02:23:11.030701072Z","pruned":[]}
4662024-10-01T02:33:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
4672024-10-01T02:33:11.050ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4682024-10-01T02:33:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4692024-10-01T02:33:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
4702024-10-01T02:33:11.052ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4712024-10-01T02:33:11.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4722024-10-01T02:33:11.054ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4732024-10-01T02:33:11.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
4742024-10-01T02:33:11.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4752024-10-01T02:33:11.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4762024-10-01T02:33:11.066ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4772024-10-01T02:33:11.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4782024-10-01T02:33:11.091ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1244, tv_nsec: 534659426 } })
4792024-10-01T02:33:11.093ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
4802024-10-01T02:33:11.096ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1244, tv_nsec: 540595205 } })
4812024-10-01T02:33:11.097ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
4822024-10-01T02:33:11.100ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4832024-10-01T02:33:11.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4842024-10-01T02:33:11.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4852024-10-01T02:33:11.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4862024-10-01T02:33:11.107ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4872024-10-01T02:33:11.111ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 79.507893ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
4882024-10-01T02:33:11.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4892024-10-01T02:33:11.115ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
4902024-10-01T02:33:11.115ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 83.476149ms iteration = 1 status = {"error":"rack not yet initialized: 52547763-7759-42e1-81a9-8b833f59f5dd"}
4912024-10-01T02:33:11.131ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4922024-10-01T02:33:11.132ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 101.656843ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4932024-10-01T02:33:11.134ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
4942024-10-01T02:33:11.134ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4952024-10-01T02:33:11.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4962024-10-01T02:33:11.136ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4972024-10-01T02:33:11.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4982024-10-01T02:33:11.137ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4992024-10-01T02:33:11.138ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5002024-10-01T02:33:11.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5012024-10-01T02:33:11.141ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5022024-10-01T02:33:11.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5032024-10-01T02:33:11.141ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5042024-10-01T02:33:11.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5052024-10-01T02:33:11.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5062024-10-01T02:33:11.145ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5072024-10-01T02:33:11.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5082024-10-01T02:33:11.149ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5092024-10-01T02:33:11.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5102024-10-01T02:33:11.155ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5112024-10-01T02:33:11.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5122024-10-01T02:33:11.159ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5132024-10-01T02:33:11.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5142024-10-01T02:33:11.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5152024-10-01T02:33:11.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5162024-10-01T02:33:11.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5172024-10-01T02:33:11.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5182024-10-01T02:33:11.180ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5192024-10-01T02:33:11.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5202024-10-01T02:33:11.181ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
5212024-10-01T02:33:11.181ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 151.238885ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
5222024-10-01T02:33:11.185ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 153.054855ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
5232024-10-01T02:33:11.185ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 153.383471ms iteration = 1 status = {"errors":[],"records_set_to_done":[]}
5242024-10-01T02:33:11.186ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 153.707206ms iteration = 1 status = {}
5252024-10-01T02:33:11.187ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5262024-10-01T02:33:11.188ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
5272024-10-01T02:33:11.188ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5282024-10-01T02:33:11.188ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5292024-10-01T02:33:11.188ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5302024-10-01T02:33:11.188ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5312024-10-01T02:33:11.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5322024-10-01T02:33:11.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5332024-10-01T02:33:11.189ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d0e0d2f-1d37-4e11-94f2-d7aa91cfc102", "content-length": "26", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
5342024-10-01T02:33:11.189ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
5352024-10-01T02:33:11.189ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5362024-10-01T02:33:11.190ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "67fe509a-a4d0-4178-ac25-efd092e570af", "content-length": "26", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
5372024-10-01T02:33:11.190ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5382024-10-01T02:33:11.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5392024-10-01T02:33:11.191ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
5402024-10-01T02:33:11.191ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 159.520713ms iteration = 1 status = {"error":"inventory collection is None"}
5412024-10-01T02:33:11.191ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5422024-10-01T02:33:11.191ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5432024-10-01T02:33:11.194ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5442024-10-01T02:33:11.194ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5452024-10-01T02:33:11.202ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
5462024-10-01T02:33:11.202ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 170.521908ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
5472024-10-01T02:33:11.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5482024-10-01T02:33:11.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5492024-10-01T02:33:11.209ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
5502024-10-01T02:33:11.209ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 179.208952ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
5512024-10-01T02:33:11.220ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
5522024-10-01T02:33:11.220ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 190.186007ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
5532024-10-01T02:33:11.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5542024-10-01T02:33:11.229ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
5552024-10-01T02:33:11.231ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1244, tv_nsec: 675454915 } })
5562024-10-01T02:33:11.232ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5572024-10-01T02:33:11.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5582024-10-01T02:33:11.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5592024-10-01T02:33:11.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 202.420472ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5602024-10-01T02:33:11.235ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
5612024-10-01T02:33:11.235ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 203.634413ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
5622024-10-01T02:33:11.243ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5632024-10-01T02:33:11.243ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5642024-10-01T02:33:11.243ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 211.016786ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5652024-10-01T02:33:11.249ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
5662024-10-01T02:33:11.249ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
5672024-10-01T02:33:11.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5682024-10-01T02:33:11.249ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 217.659198ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
5692024-10-01T02:33:11.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5702024-10-01T02:33:11.253ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5712024-10-01T02:33:11.256ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5722024-10-01T02:33:11.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5732024-10-01T02:33:11.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5742024-10-01T02:33:11.258ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5752024-10-01T02:33:11.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5762024-10-01T02:33:11.265ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5772024-10-01T02:33:11.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5782024-10-01T02:33:11.292ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 260.458084ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
5792024-10-01T02:33:11.297ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 265.55311ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
5802024-10-01T02:33:11.299ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
5812024-10-01T02:33:11.299ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 268.5175ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
5822024-10-01T02:33:11.300ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5832024-10-01T02:33:11.300ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 268.217454ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
5842024-10-01T02:33:11.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5852024-10-01T02:33:11.302ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5862024-10-01T02:33:11.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5872024-10-01T02:33:11.306ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5882024-10-01T02:33:11.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5892024-10-01T02:33:11.310ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5902024-10-01T02:33:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5912024-10-01T02:33:11.314ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5922024-10-01T02:33:11.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5932024-10-01T02:33:11.319ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5942024-10-01T02:33:11.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5952024-10-01T02:33:11.323ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
5962024-10-01T02:33:11.323ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
5972024-10-01T02:33:11.323ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
5982024-10-01T02:33:11.324ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef0af53f-2f5e-4a6d-974e-d9d31be69478", "content-length": "476", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
5992024-10-01T02:33:11.324ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6002024-10-01T02:33:11.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6012024-10-01T02:33:11.326ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6022024-10-01T02:33:11.326ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6032024-10-01T02:33:11.326ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6042024-10-01T02:33:11.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6052024-10-01T02:33:11.335ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6062024-10-01T02:33:11.335ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "37653af5-ec46-43a9-a903-8096474744e8", "content-length": "734", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6072024-10-01T02:33:11.336ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6082024-10-01T02:33:11.338ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1e67dd8-2370-46dd-a097-3e3810af76d0", "content-length": "111", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6092024-10-01T02:33:11.338ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6102024-10-01T02:33:11.338ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "382034f8-0d9a-49cd-930f-d83a027da198", "content-length": "111", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6112024-10-01T02:33:11.338ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6122024-10-01T02:33:11.339ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f202e7c-bd39-43a2-adf7-1018c923c361", "content-length": "167", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6132024-10-01T02:33:11.339ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6142024-10-01T02:33:11.340ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
6152024-10-01T02:33:11.340ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "64aa52be-f793-4909-a77b-7ed2dc8c34de", "content-length": "167", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6162024-10-01T02:33:11.340ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 307.702556ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
6172024-10-01T02:33:11.340ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6182024-10-01T02:33:11.340ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0221636c-d4cc-480e-bcda-984e442d6ad4", "content-length": "175", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6192024-10-01T02:33:11.340ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6202024-10-01T02:33:11.342ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "39028302-0829-489e-bd31-d5381a314bad", "content-length": "175", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6212024-10-01T02:33:11.342ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
6222024-10-01T02:33:11.344ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e2cbb15-63a6-433e-b4ca-3f126fd5d948", "content-length": "702", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6232024-10-01T02:33:11.345ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6242024-10-01T02:33:11.349ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6252024-10-01T02:33:11.349ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7660beff-9303-4158-8d08-413407efe28e", "content-length": "1", "date": "Tue, 01 Oct 2024 02:33:10 GMT"} })
6262024-10-01T02:33:11.350ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6272024-10-01T02:33:11.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6282024-10-01T02:33:11.351ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b33adb80-acc7-437d-858f-1227765e5b56", "content-length": "727", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6292024-10-01T02:33:11.352ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6302024-10-01T02:33:11.352ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "83267c9e-51d6-4d1b-9868-b784428b2c8e", "content-length": "729", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6312024-10-01T02:33:11.352ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6322024-10-01T02:33:11.352ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "202c9113-e721-41fc-a567-a07b58a27e43", "content-length": "728", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6332024-10-01T02:33:11.352ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
6342024-10-01T02:33:11.353ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 323.4035ms iteration = 1 status = {}
6352024-10-01T02:33:11.354ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e832563-03cd-4535-8e89-6530ede3417a", "content-length": "722", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6362024-10-01T02:33:11.354ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
6372024-10-01T02:33:11.354ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "72697d80-2ea7-41f6-875d-52e5375cf4bf", "content-length": "109", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6382024-10-01T02:33:11.354ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
6392024-10-01T02:33:11.354ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b028888-33d9-46d1-bf47-933c5bd6dd43", "content-length": "109", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6402024-10-01T02:33:11.354ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
6412024-10-01T02:33:11.356ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "08899db6-b598-44e7-ac09-9dd8abe64071", "content-length": "169", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6422024-10-01T02:33:11.356ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
6432024-10-01T02:33:11.356ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "485cc9cb-3289-40e4-8408-3355cd12bc25", "content-length": "169", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6442024-10-01T02:33:11.356ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
6452024-10-01T02:33:11.357ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdd9c23b-6f66-46c3-a0d1-9f08e6b1615c", "content-length": "178", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6462024-10-01T02:33:11.357ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
6472024-10-01T02:33:11.358ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 326.008933ms iteration = 1 status = {}
6482024-10-01T02:33:11.358ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "158527ce-c2ad-4eee-bcb1-26a1449ce19e", "content-length": "178", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6492024-10-01T02:33:11.358ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
6502024-10-01T02:33:11.358ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "50f28915-b429-44f9-84c5-35484a7f56e0", "content-length": "702", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6512024-10-01T02:33:11.358ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6522024-10-01T02:33:11.358ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "55693eca-6c25-45f1-8fed-01c79f443fab", "content-length": "727", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6532024-10-01T02:33:11.358ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6542024-10-01T02:33:11.359ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "80ecf027-17e8-438f-8f28-f21cdabb3891", "content-length": "729", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6552024-10-01T02:33:11.359ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6562024-10-01T02:33:11.359ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0bdbaa3-3b52-4598-9653-eac825751270", "content-length": "728", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6572024-10-01T02:33:11.359ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6582024-10-01T02:33:11.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6592024-10-01T02:33:11.360ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6602024-10-01T02:33:11.360ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6612024-10-01T02:33:11.360ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6622024-10-01T02:33:11.360ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 328.406694ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6632024-10-01T02:33:11.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6642024-10-01T02:33:11.362ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6652024-10-01T02:33:11.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6662024-10-01T02:33:11.363ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6672024-10-01T02:33:11.363ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6682024-10-01T02:33:11.366ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
6692024-10-01T02:33:11.366ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6702024-10-01T02:33:11.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6712024-10-01T02:33:11.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6722024-10-01T02:33:11.367ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6732024-10-01T02:33:11.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6742024-10-01T02:33:11.367ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6752024-10-01T02:33:11.369ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
6762024-10-01T02:33:11.369ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6772024-10-01T02:33:11.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6782024-10-01T02:33:11.369ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6792024-10-01T02:33:11.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6802024-10-01T02:33:11.371ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6812024-10-01T02:33:11.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6822024-10-01T02:33:11.378ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 347.874369ms iteration = 1 status = null
6832024-10-01T02:33:11.383ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6842024-10-01T02:33:11.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6852024-10-01T02:33:11.385ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6862024-10-01T02:33:11.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6872024-10-01T02:33:11.387ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6882024-10-01T02:33:11.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6892024-10-01T02:33:11.389ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6902024-10-01T02:33:11.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6912024-10-01T02:33:11.393ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6922024-10-01T02:33:11.396ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
6932024-10-01T02:33:11.396ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6942024-10-01T02:33:11.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6952024-10-01T02:33:11.407ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6962024-10-01T02:33:11.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6972024-10-01T02:33:11.434ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6982024-10-01T02:33:11.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6992024-10-01T02:33:11.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7002024-10-01T02:33:11.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7012024-10-01T02:33:11.439ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7022024-10-01T02:33:11.443ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7032024-10-01T02:33:11.443ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7042024-10-01T02:33:11.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7052024-10-01T02:33:11.451ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7062024-10-01T02:33:11.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7072024-10-01T02:33:11.453ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7082024-10-01T02:33:11.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7092024-10-01T02:33:11.455ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7102024-10-01T02:33:11.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7112024-10-01T02:33:11.458ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7122024-10-01T02:33:11.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7132024-10-01T02:33:11.459ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7142024-10-01T02:33:11.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7152024-10-01T02:33:11.461ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7162024-10-01T02:33:11.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7172024-10-01T02:33:11.463ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7182024-10-01T02:33:11.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7192024-10-01T02:33:11.465ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7202024-10-01T02:33:11.468ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7212024-10-01T02:33:11.468ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7222024-10-01T02:33:11.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7232024-10-01T02:33:11.470ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7242024-10-01T02:33:11.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7252024-10-01T02:33:11.471ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7262024-10-01T02:33:11.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7272024-10-01T02:33:11.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0f0ca0dc-a867-4ec7-933b-cfad562f6087 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
7282024-10-01T02:33:11.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0f0ca0dc-a867-4ec7-933b-cfad562f6087 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
7292024-10-01T02:33:11.473ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7302024-10-01T02:33:11.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0f0ca0dc-a867-4ec7-933b-cfad562f6087 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
7312024-10-01T02:33:11.476ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7322024-10-01T02:33:11.476ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7332024-10-01T02:33:11.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7342024-10-01T02:33:11.482ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
7352024-10-01T02:33:11.482ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7362024-10-01T02:33:11.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7372024-10-01T02:33:11.482ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
7382024-10-01T02:33:11.483ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7392024-10-01T02:33:11.483ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7402024-10-01T02:33:11.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7412024-10-01T02:33:11.485ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
7422024-10-01T02:33:11.485ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7432024-10-01T02:33:11.487ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
7442024-10-01T02:33:11.487ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7452024-10-01T02:33:11.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7462024-10-01T02:33:11.487ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7472024-10-01T02:33:11.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7482024-10-01T02:33:11.506ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:53 sled_uuid = 2a571ec0-85a3-450e-88fc-680c13ffa211
7492024-10-01T02:33:11.516ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
7502024-10-01T02:33:11.516ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
7512024-10-01T02:33:11.516ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
7522024-10-01T02:33:11.517ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7532024-10-01T02:33:11.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7542024-10-01T02:33:11.520ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7552024-10-01T02:33:11.521ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7562024-10-01T02:33:11.521ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7572024-10-01T02:33:11.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7582024-10-01T02:33:11.524ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7592024-10-01T02:33:11.527ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7602024-10-01T02:33:11.527ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7612024-10-01T02:33:11.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7622024-10-01T02:33:11.539ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 507.236379ms iteration = 1 status = {}
7632024-10-01T02:33:11.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64821 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fb5905d0-8b85-4fe3-aa30-a747b90ef152 response_code = 204 uri = /sled-agents/2a571ec0-85a3-450e-88fc-680c13ffa211
7642024-10-01T02:33:11.799ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
7652024-10-01T02:33:11.799ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
7662024-10-01T02:33:11.799ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
7672024-10-01T02:33:11.800ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 765.698142ms
7682024-10-01T02:33:11.800ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 767.573783ms iteration = 1 status = {}
7692024-10-01T02:33:11.850ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = f4292df9-35df-497b-a9dc-2e40f77ad419 file = nexus/db-queries/src/db/datastore/inventory.rs:970
7702024-10-01T02:33:11.851ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = f4292df9-35df-497b-a9dc-2e40f77ad419 time_started = 2024-10-01 02:33:11.319852 UTC
7712024-10-01T02:33:11.851ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 818.929593ms iteration = 1 status = {"collection_id":"f4292df9-35df-497b-a9dc-2e40f77ad419","time_done":"2024-10-01 02:33:11.482205 UTC","time_started":"2024-10-01 02:33:11.319852 UTC"}
7722024-10-01T02:33:11.851ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
7732024-10-01T02:33:11.851ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7742024-10-01T02:33:11.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7752024-10-01T02:33:11.851ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
7762024-10-01T02:33:11.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7772024-10-01T02:33:11.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7782024-10-01T02:33:11.853ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7792024-10-01T02:33:11.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7802024-10-01T02:33:11.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7812024-10-01T02:33:11.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7822024-10-01T02:33:11.855ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
7832024-10-01T02:33:11.855ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7842024-10-01T02:33:11.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7852024-10-01T02:33:11.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7862024-10-01T02:33:11.857ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
7872024-10-01T02:33:11.857ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.864218ms iteration = 2 status = {"error":"rack not yet initialized: 52547763-7759-42e1-81a9-8b833f59f5dd"}
7882024-10-01T02:33:12.059ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(f4292df9-35df-497b-a9dc-2e40f77ad419, 0), (c4c1c8ca-7be6-4a78-9a5c-d371c17c5887, 0)]
7892024-10-01T02:33:12.061ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1245, tv_nsec: 504918665 } })
7902024-10-01T02:33:12.099ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
7912024-10-01T02:33:12.099ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
7922024-10-01T02:33:12.099ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
7932024-10-01T02:33:12.101ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "db6cb137-212d-4a71-bd91-d0d9791a9794", "content-length": "476", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
7942024-10-01T02:33:12.101ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
7952024-10-01T02:33:12.101ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6add6997-71dd-4cbc-8a3e-4731c0007bd0", "content-length": "734", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
7962024-10-01T02:33:12.101ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
7972024-10-01T02:33:12.102ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e23dc0f2-6ede-442f-9835-6745d46441de", "content-length": "111", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
7982024-10-01T02:33:12.102ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
7992024-10-01T02:33:12.103ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "42bec2b2-f8be-4ebe-b613-2ee55f73c70f", "content-length": "111", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8002024-10-01T02:33:12.103ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
8012024-10-01T02:33:12.103ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5eb21cd7-a456-43a4-a7a5-1d78da8467f5", "content-length": "167", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8022024-10-01T02:33:12.103ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
8032024-10-01T02:33:12.103ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca57bee1-0e2a-4f90-ab28-170ff7f1f5a0", "content-length": "167", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8042024-10-01T02:33:12.103ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
8052024-10-01T02:33:12.104ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4022472b-4073-418c-b034-f1d5fbcb3b53", "content-length": "175", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8062024-10-01T02:33:12.104ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
8072024-10-01T02:33:12.105ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8513ac9-9193-45f6-a4de-e2b28dde472c", "content-length": "175", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8082024-10-01T02:33:12.105ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
8092024-10-01T02:33:12.105ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "13fdc15e-8a00-4b7f-b0c5-1725cadba025", "content-length": "702", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8102024-10-01T02:33:12.105ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8112024-10-01T02:33:12.106ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "206f7d31-2d87-43ba-9636-8bd88832b77b", "content-length": "727", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8122024-10-01T02:33:12.106ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8132024-10-01T02:33:12.106ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6b79394-0ecb-4c94-a2ba-93118a2b9689", "content-length": "729", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8142024-10-01T02:33:12.106ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8152024-10-01T02:33:12.107ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "98fa7dc5-3527-4492-b5ae-9a8044a779c7", "content-length": "728", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8162024-10-01T02:33:12.107ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
8172024-10-01T02:33:12.107ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "24a12eab-e444-4d2a-8160-213b13048411", "content-length": "722", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8182024-10-01T02:33:12.107ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
8192024-10-01T02:33:12.107ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "98735d46-a9de-40aa-9760-39f8bcdf0335", "content-length": "109", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8202024-10-01T02:33:12.107ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
8212024-10-01T02:33:12.108ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0aaf1dab-608d-484f-a2f0-cd4c182fad7c", "content-length": "109", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8222024-10-01T02:33:12.108ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
8232024-10-01T02:33:12.108ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac557daa-cb78-417e-bdb8-ea54e98b260c", "content-length": "169", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8242024-10-01T02:33:12.108ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
8252024-10-01T02:33:12.109ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "df2edcc0-952b-47c6-8209-6d77aeb4d0e5", "content-length": "169", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8262024-10-01T02:33:12.109ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
8272024-10-01T02:33:12.110ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "051ca4cb-bf7b-47cd-8f00-840234ef3aff", "content-length": "178", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8282024-10-01T02:33:12.110ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
8292024-10-01T02:33:12.110ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b11ed878-afd8-4e9b-8cca-7d3960d5d59f", "content-length": "178", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8302024-10-01T02:33:12.110ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
8312024-10-01T02:33:12.111ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ae79a65-7486-42ff-8366-6a9ef9a907ab", "content-length": "702", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8322024-10-01T02:33:12.111ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
8332024-10-01T02:33:12.112ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "72833fcb-9fac-429a-a1bd-031cc193f624", "content-length": "727", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8342024-10-01T02:33:12.112ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
8352024-10-01T02:33:12.112ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e224ed43-ffdd-4a23-b878-b3958b5a056c", "content-length": "729", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8362024-10-01T02:33:12.112ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
8372024-10-01T02:33:12.112ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fad0906-0ca4-4e90-aaa2-e30d6b248193", "content-length": "728", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8382024-10-01T02:33:12.112ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8392024-10-01T02:33:12.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8402024-10-01T02:33:12.115ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8412024-10-01T02:33:12.117ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
8422024-10-01T02:33:12.117ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8432024-10-01T02:33:12.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8442024-10-01T02:33:12.119ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8452024-10-01T02:33:12.120ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
8462024-10-01T02:33:12.120ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8472024-10-01T02:33:12.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8482024-10-01T02:33:12.155ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
8492024-10-01T02:33:12.155ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
8502024-10-01T02:33:12.177ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8512024-10-01T02:33:12.177ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8522024-10-01T02:33:12.179ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8532024-10-01T02:33:12.179ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8542024-10-01T02:33:12.181ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8552024-10-01T02:33:12.183ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 52547763-7759-42e1-81a9-8b833f59f5dd, lookup_type: ById(52547763-7759-42e1-81a9-8b833f59f5dd) } result = Ok(())
8562024-10-01T02:33:12.183ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 52547763-7759-42e1-81a9-8b833f59f5dd, time_created: 2024-10-01T02:33:11.371096Z, time_modified: 2024-10-01T02:33:11.371096Z }, initialized: false, tuf_base_url: None, rack_subnet: None } file = nexus/src/app/rack.rs:764
8572024-10-01T02:33:12.365ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "54ccc9db-0f68-498e-aa2d-26d00876f990", "content-length": "20058", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8582024-10-01T02:33:12.366ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/omicron-zones
8592024-10-01T02:33:12.373ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/omicron-zones", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f43e7c3-5b75-450f-a546-c81192bb949e", "content-length": "10314", "date": "Tue, 01 Oct 2024 02:33:12 GMT"} })
8602024-10-01T02:33:12.375ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
8612024-10-01T02:33:12.375ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8622024-10-01T02:33:12.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8632024-10-01T02:33:12.377ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8642024-10-01T02:33:12.379ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
8652024-10-01T02:33:12.382ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8662024-10-01T02:33:12.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8672024-10-01T02:33:12.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 481c7f46-aa72-49b1-bf59-4d32b5642040 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
8682024-10-01T02:33:12.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 481c7f46-aa72-49b1-bf59-4d32b5642040 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
8692024-10-01T02:33:12.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 481c7f46-aa72-49b1-bf59-4d32b5642040 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
8702024-10-01T02:33:12.872ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = be89f38c-d395-41e2-899a-3fcfb38880dd file = nexus/db-queries/src/db/datastore/inventory.rs:970
8712024-10-01T02:33:12.873ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = be89f38c-d395-41e2-899a-3fcfb38880dd time_started = 2024-10-01 02:33:12.098298 UTC
8722024-10-01T02:33:12.873ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.021909064s iteration = 2 status = {"collection_id":"be89f38c-d395-41e2-899a-3fcfb38880dd","time_done":"2024-10-01 02:33:12.375980 UTC","time_started":"2024-10-01 02:33:12.098298 UTC"}
8732024-10-01T02:33:12.873ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
8742024-10-01T02:33:12.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8752024-10-01T02:33:12.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8762024-10-01T02:33:12.875ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8772024-10-01T02:33:12.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8782024-10-01T02:33:12.876ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8792024-10-01T02:33:12.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8802024-10-01T02:33:12.878ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
8812024-10-01T02:33:12.878ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.764747ms iteration = 3 status = {"error":"rack not yet initialized: 52547763-7759-42e1-81a9-8b833f59f5dd"}
8822024-10-01T02:33:13.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5cf380ca-7561-444c-a99f-270d6bc044f4 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
8832024-10-01T02:33:13.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5cf380ca-7561-444c-a99f-270d6bc044f4 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
8842024-10-01T02:33:13.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 12541 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5cf380ca-7561-444c-a99f-270d6bc044f4 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
8852024-10-01T02:33:14.184ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8862024-10-01T02:33:14.184ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8872024-10-01T02:33:14.186ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8882024-10-01T02:33:14.186ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8892024-10-01T02:33:14.187ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8902024-10-01T02:33:14.189ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 52547763-7759-42e1-81a9-8b833f59f5dd, lookup_type: ById(52547763-7759-42e1-81a9-8b833f59f5dd) } result = Ok(())
8912024-10-01T02:33:14.189ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:761
8922024-10-01T02:33:14.189ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
8932024-10-01T02:33:14.189ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
8942024-10-01T02:33:14.192ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
8952024-10-01T02:33:14.192ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
8962024-10-01T02:33:14.288ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
8972024-10-01T02:33:14.288ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
8982024-10-01T02:33:14.290ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
8992024-10-01T02:33:14.290ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9002024-10-01T02:33:14.292ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9012024-10-01T02:33:14.292ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9022024-10-01T02:33:14.294ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9032024-10-01T02:33:14.294ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9042024-10-01T02:33:14.297ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9052024-10-01T02:33:14.300ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
9062024-10-01T02:33:14.300ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9072024-10-01T02:33:14.300ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9082024-10-01T02:33:14.301ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9092024-10-01T02:33:14.302ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9102024-10-01T02:33:14.303ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9112024-10-01T02:33:14.303ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9122024-10-01T02:33:14.304ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9132024-10-01T02:33:14.307ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
9142024-10-01T02:33:14.307ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9152024-10-01T02:33:14.307ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9162024-10-01T02:33:14.309ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9172024-10-01T02:33:14.310ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9182024-10-01T02:33:14.315ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9192024-10-01T02:33:14.315ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9202024-10-01T02:33:14.316ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9212024-10-01T02:33:14.317ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9222024-10-01T02:33:14.318ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9232024-10-01T02:33:14.318ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9242024-10-01T02:33:14.319ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9252024-10-01T02:33:14.320ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9262024-10-01T02:33:14.321ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9272024-10-01T02:33:14.321ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9282024-10-01T02:33:14.322ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9292024-10-01T02:33:14.325ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
9302024-10-01T02:33:14.326ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9312024-10-01T02:33:14.326ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9322024-10-01T02:33:14.327ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9332024-10-01T02:33:14.327ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9342024-10-01T02:33:14.329ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9352024-10-01T02:33:14.329ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9362024-10-01T02:33:14.332ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9372024-10-01T02:33:14.332ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9382024-10-01T02:33:14.333ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9392024-10-01T02:33:14.333ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9402024-10-01T02:33:14.334ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9412024-10-01T02:33:14.334ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9422024-10-01T02:33:14.335ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9432024-10-01T02:33:14.336ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9442024-10-01T02:33:14.337ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9452024-10-01T02:33:14.341ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
9462024-10-01T02:33:14.341ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9472024-10-01T02:33:14.341ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9482024-10-01T02:33:14.342ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9492024-10-01T02:33:14.342ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9502024-10-01T02:33:14.343ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9512024-10-01T02:33:14.343ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9522024-10-01T02:33:14.345ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9532024-10-01T02:33:14.348ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
9542024-10-01T02:33:14.348ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9552024-10-01T02:33:14.348ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9562024-10-01T02:33:14.353ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9572024-10-01T02:33:14.353ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9582024-10-01T02:33:14.357ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9592024-10-01T02:33:14.357ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9602024-10-01T02:33:14.359ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9612024-10-01T02:33:14.360ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9622024-10-01T02:33:14.361ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9632024-10-01T02:33:14.361ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9642024-10-01T02:33:14.363ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9652024-10-01T02:33:14.363ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9662024-10-01T02:33:14.365ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9672024-10-01T02:33:14.365ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9682024-10-01T02:33:14.366ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9692024-10-01T02:33:14.366ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9702024-10-01T02:33:14.368ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9712024-10-01T02:33:14.371ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
9722024-10-01T02:33:14.371ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9732024-10-01T02:33:14.371ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9742024-10-01T02:33:14.373ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9752024-10-01T02:33:14.373ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9762024-10-01T02:33:14.374ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9772024-10-01T02:33:14.374ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9782024-10-01T02:33:14.376ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9792024-10-01T02:33:14.379ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
9802024-10-01T02:33:14.379ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9812024-10-01T02:33:14.380ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9822024-10-01T02:33:14.387ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 611bfb6e-9731-4e0b-9af8-03e07b661aa3, kind: Service { id: 772acfa5-ee20-4a17-a053-c207ffa50ed6 }, name: Name("nexus-772acfa5-ee20-4a17-a053-c207ffa50ed6"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 98b85cfc-ac80-4175-9f04-dd15c9b20d24, kind: Service { id: 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35 }, name: Name("nexus-3dfd7033-71d8-4eb9-bb97-49dae3b5cd35"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 29])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a840a1d8-f258-45fe-96a0-7b8383461d51, kind: Service { id: e9e4c757-e076-4386-92e2-8217b8bb307d }, name: Name("nexus-e9e4c757-e076-4386-92e2-8217b8bb307d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 498a9376-2ad6-4307-b191-e6d73cf2f1a4, kind: Service { id: 0a1ed896-5078-4267-b636-10151376f015 }, name: Name("external-dns-0a1ed896-5078-4267-b636-10151376f015"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4ffe935-3383-46e7-947f-e87df509f06f, kind: Service { id: eb937866-c779-4a9e-aec4-cc18302d4ce1 }, name: Name("external-dns-eb937866-c779-4a9e-aec4-cc18302d4ce1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 225])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
9832024-10-01T02:33:14.387ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9842024-10-01T02:33:14.388ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9852024-10-01T02:33:14.389ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9862024-10-01T02:33:14.390ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
9872024-10-01T02:33:14.390ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9882024-10-01T02:33:14.390ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9892024-10-01T02:33:14.407ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
9902024-10-01T02:33:14.409ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 498a9376-2ad6-4307-b191-e6d73cf2f1a4, kind: Service { id: 0a1ed896-5078-4267-b636-10151376f015 }, name: Name("external-dns-0a1ed896-5078-4267-b636-10151376f015"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4ffe935-3383-46e7-947f-e87df509f06f, kind: Service { id: eb937866-c779-4a9e-aec4-cc18302d4ce1 }, name: Name("external-dns-eb937866-c779-4a9e-aec4-cc18302d4ce1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 225])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 611bfb6e-9731-4e0b-9af8-03e07b661aa3, kind: Service { id: 772acfa5-ee20-4a17-a053-c207ffa50ed6 }, name: Name("nexus-772acfa5-ee20-4a17-a053-c207ffa50ed6"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 98b85cfc-ac80-4175-9f04-dd15c9b20d24, kind: Service { id: 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35 }, name: Name("nexus-3dfd7033-71d8-4eb9-bb97-49dae3b5cd35"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 29])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a840a1d8-f258-45fe-96a0-7b8383461d51, kind: Service { id: e9e4c757-e076-4386-92e2-8217b8bb307d }, name: Name("nexus-e9e4c757-e076-4386-92e2-8217b8bb307d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
9912024-10-01T02:33:14.410ZDEBGnexus (InternalApi): resolved 2 rules for sleds
9922024-10-01T02:33:14.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ff83e37a-4a43-4451-aee8-4a4af1d468ea roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
9932024-10-01T02:33:14.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ff83e37a-4a43-4451-aee8-4a4af1d468ea resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
9942024-10-01T02:33:14.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ff83e37a-4a43-4451-aee8-4a4af1d468ea response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
9952024-10-01T02:33:14.608ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 2a571ec0-85a3-450e-88fc-680c13ffa211, time_created: 2024-10-01T02:33:11.506220Z, time_modified: 2024-10-01T02:33:11.506220Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
9962024-10-01T02:33:14.608ZDEBGnexus (InternalApi): sending firewall rules to sled agents
9972024-10-01T02:33:14.608ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9982024-10-01T02:33:14.608ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9992024-10-01T02:33:14.610ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10002024-10-01T02:33:14.610ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10012024-10-01T02:33:14.612ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10022024-10-01T02:33:14.614ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
10032024-10-01T02:33:14.646ZDEBGnexus (InternalApi): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
10042024-10-01T02:33:14.647ZDEBGnexus (InternalApi): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "735a828d-668c-4cf4-9379-d0a886e0b6af", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
10052024-10-01T02:33:14.648ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
10062024-10-01T02:33:14.648ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
10072024-10-01T02:33:15.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7b0b7b19-90ba-4cba-b847-d9a42e586e09 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10082024-10-01T02:33:15.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7b0b7b19-90ba-4cba-b847-d9a42e586e09 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10092024-10-01T02:33:15.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3617 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7b0b7b19-90ba-4cba-b847-d9a42e586e09 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10102024-10-01T02:33:16.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1326b7da-1279-4f97-aeeb-b5617e0d3d27 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10112024-10-01T02:33:16.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1326b7da-1279-4f97-aeeb-b5617e0d3d27 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10122024-10-01T02:33:16.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1326b7da-1279-4f97-aeeb-b5617e0d3d27 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10132024-10-01T02:33:17.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 95320873-97f2-49f1-b38c-affb86f31d44 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10142024-10-01T02:33:17.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 95320873-97f2-49f1-b38c-affb86f31d44 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10152024-10-01T02:33:17.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 95320873-97f2-49f1-b38c-affb86f31d44 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10162024-10-01T02:33:18.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 92d827ec-6d48-43c5-a068-b98c84c19384 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10172024-10-01T02:33:18.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 92d827ec-6d48-43c5-a068-b98c84c19384 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10182024-10-01T02:33:18.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 92d827ec-6d48-43c5-a068-b98c84c19384 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10192024-10-01T02:33:19.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5a293112-e19f-40a0-bfa9-72ed2a086c31 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10202024-10-01T02:33:19.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5a293112-e19f-40a0-bfa9-72ed2a086c31 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10212024-10-01T02:33:19.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1875 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5a293112-e19f-40a0-bfa9-72ed2a086c31 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10222024-10-01T02:33:20.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c6be8916-19de-4090-8c8b-1b8f46d6ac1b roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10232024-10-01T02:33:20.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c6be8916-19de-4090-8c8b-1b8f46d6ac1b resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10242024-10-01T02:33:20.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c6be8916-19de-4090-8c8b-1b8f46d6ac1b response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10252024-10-01T02:33:21.030ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
10262024-10-01T02:33:21.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10272024-10-01T02:33:21.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10282024-10-01T02:33:21.031ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
10292024-10-01T02:33:21.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10302024-10-01T02:33:21.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10312024-10-01T02:33:21.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10322024-10-01T02:33:21.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10332024-10-01T02:33:21.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10342024-10-01T02:33:21.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10352024-10-01T02:33:21.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10362024-10-01T02:33:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10372024-10-01T02:33:21.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10382024-10-01T02:33:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
10392024-10-01T02:33:21.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10402024-10-01T02:33:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10412024-10-01T02:33:21.074ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10422024-10-01T02:33:21.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10432024-10-01T02:33:21.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.648338ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10442024-10-01T02:33:21.235ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
10452024-10-01T02:33:21.235ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 204.244183ms iteration = 2 status = {"enabled":false,"status":"first target blueprint","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z","time_found":"2024-10-01T02:33:21.235181037Z"}
10462024-10-01T02:33:21.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
10472024-10-01T02:33:21.235ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07
10482024-10-01T02:33:21.235ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 6.26\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07"}
10492024-10-01T02:33:21.235ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
10502024-10-01T02:33:21.235ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10512024-10-01T02:33:21.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10522024-10-01T02:33:21.235ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10532024-10-01T02:33:21.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10542024-10-01T02:33:21.235ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10552024-10-01T02:33:21.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10562024-10-01T02:33:21.235ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10572024-10-01T02:33:21.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10582024-10-01T02:33:21.236ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10592024-10-01T02:33:21.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10602024-10-01T02:33:21.237ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10612024-10-01T02:33:21.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
10622024-10-01T02:33:21.239ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10632024-10-01T02:33:21.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10642024-10-01T02:33:21.239ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10652024-10-01T02:33:21.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
10662024-10-01T02:33:21.241ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10672024-10-01T02:33:21.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10682024-10-01T02:33:21.241ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10692024-10-01T02:33:21.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
10702024-10-01T02:33:21.242ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10712024-10-01T02:33:21.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10722024-10-01T02:33:21.244ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10732024-10-01T02:33:21.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
10742024-10-01T02:33:21.245ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10752024-10-01T02:33:21.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10762024-10-01T02:33:21.245ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10772024-10-01T02:33:21.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
10782024-10-01T02:33:21.247ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10792024-10-01T02:33:21.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10802024-10-01T02:33:21.279ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
10812024-10-01T02:33:21.312ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
10822024-10-01T02:33:21.348ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
10832024-10-01T02:33:21.380ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
10842024-10-01T02:33:21.413ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
10852024-10-01T02:33:21.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1f2c3ea2-c481-464e-b3eb-3112c4f4cd7b roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10862024-10-01T02:33:21.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1f2c3ea2-c481-464e-b3eb-3112c4f4cd7b resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10872024-10-01T02:33:21.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1f2c3ea2-c481-464e-b3eb-3112c4f4cd7b response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
10882024-10-01T02:33:22.513ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "20569fa4-b52f-416c-967b-9b34149642a5", "content-length": "64", "date": "Tue, 01 Oct 2024 02:33:22 GMT"} })
10892024-10-01T02:33:22.513ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10902024-10-01T02:33:22.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10912024-10-01T02:33:22.516ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10922024-10-01T02:33:22.517ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
10932024-10-01T02:33:22.517ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10942024-10-01T02:33:22.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10952024-10-01T02:33:22.528ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "11b806ce-a144-46ef-8227-25c07bf02cb5", "content-length": "64", "date": "Tue, 01 Oct 2024 02:33:22 GMT"} })
10962024-10-01T02:33:22.528ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10972024-10-01T02:33:22.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10982024-10-01T02:33:22.530ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10992024-10-01T02:33:22.531ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11002024-10-01T02:33:22.531ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11012024-10-01T02:33:22.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11022024-10-01T02:33:22.563ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "56759257-3dc6-472a-a5fe-e553dce40808", "content-length": "64", "date": "Tue, 01 Oct 2024 02:33:22 GMT"} })
11032024-10-01T02:33:22.563ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11042024-10-01T02:33:22.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11052024-10-01T02:33:22.565ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11062024-10-01T02:33:22.566ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11072024-10-01T02:33:22.566ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11082024-10-01T02:33:22.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11092024-10-01T02:33:22.572ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f583cba9-b3a3-4478-be0e-4bf4394efe79", "content-length": "64", "date": "Tue, 01 Oct 2024 02:33:21 GMT"} })
11102024-10-01T02:33:22.572ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11112024-10-01T02:33:22.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11122024-10-01T02:33:22.573ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11132024-10-01T02:33:22.574ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11142024-10-01T02:33:22.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11152024-10-01T02:33:22.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11162024-10-01T02:33:22.592ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8939467e-122e-4053-9bbb-6f534ae14576", "content-length": "64", "date": "Tue, 01 Oct 2024 02:33:21 GMT"} })
11172024-10-01T02:33:22.592ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11182024-10-01T02:33:22.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11192024-10-01T02:33:22.594ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11202024-10-01T02:33:22.595ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11212024-10-01T02:33:22.595ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11222024-10-01T02:33:22.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11232024-10-01T02:33:22.609ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.373911072s iteration = 2 status = {"nsuccess":5}
11242024-10-01T02:33:22.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8974316b-c771-4321-8bd3-72b4f006f054 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11252024-10-01T02:33:22.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8974316b-c771-4321-8bd3-72b4f006f054 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11262024-10-01T02:33:22.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8974316b-c771-4321-8bd3-72b4f006f054 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11272024-10-01T02:33:23.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8e0bf6d6-6843-4609-a47d-4831556c765d roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11282024-10-01T02:33:23.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8e0bf6d6-6843-4609-a47d-4831556c765d resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11292024-10-01T02:33:23.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1597 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8e0bf6d6-6843-4609-a47d-4831556c765d response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11302024-10-01T02:33:24.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9924a28d-4177-4e64-a0f3-61f5864b45e3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11312024-10-01T02:33:24.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9924a28d-4177-4e64-a0f3-61f5864b45e3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11322024-10-01T02:33:24.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9924a28d-4177-4e64-a0f3-61f5864b45e3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11332024-10-01T02:33:25.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 20d931b1-2880-4208-884e-7e93e27a15fd roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11342024-10-01T02:33:25.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 20d931b1-2880-4208-884e-7e93e27a15fd resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11352024-10-01T02:33:25.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 20d931b1-2880-4208-884e-7e93e27a15fd response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11362024-10-01T02:33:26.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a55a322d-7d54-4c93-85ac-677959abd293 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11372024-10-01T02:33:26.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a55a322d-7d54-4c93-85ac-677959abd293 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11382024-10-01T02:33:26.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a55a322d-7d54-4c93-85ac-677959abd293 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11392024-10-01T02:33:27.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 19d1e888-c3f1-4ded-98e4-9adaf9336252 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11402024-10-01T02:33:27.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 19d1e888-c3f1-4ded-98e4-9adaf9336252 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11412024-10-01T02:33:27.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 19d1e888-c3f1-4ded-98e4-9adaf9336252 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11422024-10-01T02:33:28.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8ae0ec74-1c92-47ca-9224-4359fc61a023 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11432024-10-01T02:33:28.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8ae0ec74-1c92-47ca-9224-4359fc61a023 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11442024-10-01T02:33:28.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1845 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8ae0ec74-1c92-47ca-9224-4359fc61a023 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11452024-10-01T02:33:29.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fe124ada-aa29-4d0f-8b33-40f812bcaac3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11462024-10-01T02:33:29.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fe124ada-aa29-4d0f-8b33-40f812bcaac3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11472024-10-01T02:33:29.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fe124ada-aa29-4d0f-8b33-40f812bcaac3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11482024-10-01T02:33:30.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 776c9251-612d-45c8-a914-b6eaa50a1d8b roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11492024-10-01T02:33:30.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 776c9251-612d-45c8-a914-b6eaa50a1d8b resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11502024-10-01T02:33:30.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 776c9251-612d-45c8-a914-b6eaa50a1d8b response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11512024-10-01T02:33:31.031ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
11522024-10-01T02:33:31.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11532024-10-01T02:33:31.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11542024-10-01T02:33:31.031ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
11552024-10-01T02:33:31.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11562024-10-01T02:33:31.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11572024-10-01T02:33:31.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11582024-10-01T02:33:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11592024-10-01T02:33:31.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11602024-10-01T02:33:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11612024-10-01T02:33:31.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11622024-10-01T02:33:31.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11632024-10-01T02:33:31.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11642024-10-01T02:33:31.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
11652024-10-01T02:33:31.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11662024-10-01T02:33:31.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11672024-10-01T02:33:31.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11682024-10-01T02:33:31.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11692024-10-01T02:33:31.063ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.413276ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11702024-10-01T02:33:31.272ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
11712024-10-01T02:33:31.279ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 248.120978ms iteration = 3 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
11722024-10-01T02:33:31.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7582dd3e-027a-41f8-a935-d68e61c14099 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11732024-10-01T02:33:31.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7582dd3e-027a-41f8-a935-d68e61c14099 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11742024-10-01T02:33:31.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7582dd3e-027a-41f8-a935-d68e61c14099 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11752024-10-01T02:33:32.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 80f27470-2869-4ecf-b60d-cf518b90057a roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11762024-10-01T02:33:32.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 80f27470-2869-4ecf-b60d-cf518b90057a resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11772024-10-01T02:33:32.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 80f27470-2869-4ecf-b60d-cf518b90057a response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11782024-10-01T02:33:34.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = da892d29-8f1d-4651-aaba-96150afe5579 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11792024-10-01T02:33:34.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = da892d29-8f1d-4651-aaba-96150afe5579 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11802024-10-01T02:33:34.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = da892d29-8f1d-4651-aaba-96150afe5579 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11812024-10-01T02:33:35.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a6ef18ab-ecd6-4f5b-b9b6-81296d26c7ee roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11822024-10-01T02:33:35.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a6ef18ab-ecd6-4f5b-b9b6-81296d26c7ee resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11832024-10-01T02:33:35.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a6ef18ab-ecd6-4f5b-b9b6-81296d26c7ee response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11842024-10-01T02:33:36.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a8d356c5-b5fe-4f29-a4d0-14d158336555 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11852024-10-01T02:33:36.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a8d356c5-b5fe-4f29-a4d0-14d158336555 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11862024-10-01T02:33:36.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a8d356c5-b5fe-4f29-a4d0-14d158336555 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11872024-10-01T02:33:37.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6fcf23e0-1155-42be-b8e0-fdab967e2d81 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11882024-10-01T02:33:37.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6fcf23e0-1155-42be-b8e0-fdab967e2d81 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11892024-10-01T02:33:37.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6fcf23e0-1155-42be-b8e0-fdab967e2d81 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11902024-10-01T02:33:38.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 88ed220f-a346-46f4-948a-a0004c249a85 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11912024-10-01T02:33:38.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 88ed220f-a346-46f4-948a-a0004c249a85 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11922024-10-01T02:33:38.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 88ed220f-a346-46f4-948a-a0004c249a85 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11932024-10-01T02:33:39.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 02a0ea0e-62d2-4b14-bcf5-ad72ff6ad3c8 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11942024-10-01T02:33:39.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 02a0ea0e-62d2-4b14-bcf5-ad72ff6ad3c8 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11952024-10-01T02:33:39.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 02a0ea0e-62d2-4b14-bcf5-ad72ff6ad3c8 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11962024-10-01T02:33:40.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b38889ae-b48c-4ec6-887a-885b8ac95bcb roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11972024-10-01T02:33:40.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b38889ae-b48c-4ec6-887a-885b8ac95bcb resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11982024-10-01T02:33:40.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b38889ae-b48c-4ec6-887a-885b8ac95bcb response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
11992024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
12002024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12012024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
12022024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
12032024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
12042024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12052024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
12062024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
12072024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
12082024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
12092024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
12102024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
12112024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12122024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
12132024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12142024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
12152024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12162024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
12172024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
12182024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12192024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12202024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
12212024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12222024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
12232024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
12242024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
12252024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12262024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
12272024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12282024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12292024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
12302024-10-01T02:33:41.031ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
12312024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12322024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12332024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12342024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12352024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
12362024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
12372024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
12382024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12392024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12402024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12412024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12422024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12432024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12442024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12452024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12462024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12472024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12482024-10-01T02:33:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12492024-10-01T02:33:41.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12502024-10-01T02:33:41.035ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1274, tv_nsec: 478589116 } })
12512024-10-01T02:33:41.035ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
12522024-10-01T02:33:41.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12532024-10-01T02:33:41.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12542024-10-01T02:33:41.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12552024-10-01T02:33:41.038ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.410278ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
12562024-10-01T02:33:41.039ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12572024-10-01T02:33:41.040ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12582024-10-01T02:33:41.040ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12592024-10-01T02:33:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12602024-10-01T02:33:41.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
12612024-10-01T02:33:41.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12622024-10-01T02:33:41.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12632024-10-01T02:33:41.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12642024-10-01T02:33:41.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12652024-10-01T02:33:41.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12662024-10-01T02:33:41.044ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12672024-10-01T02:33:41.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
12682024-10-01T02:33:41.046ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12692024-10-01T02:33:41.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12702024-10-01T02:33:41.053ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12712024-10-01T02:33:41.053ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
12722024-10-01T02:33:41.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12732024-10-01T02:33:41.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12742024-10-01T02:33:41.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12752024-10-01T02:33:41.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12762024-10-01T02:33:41.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12772024-10-01T02:33:41.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12782024-10-01T02:33:41.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12792024-10-01T02:33:41.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12802024-10-01T02:33:41.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12812024-10-01T02:33:41.064ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12822024-10-01T02:33:41.067ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12832024-10-01T02:33:41.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12842024-10-01T02:33:41.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12852024-10-01T02:33:41.067ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12862024-10-01T02:33:41.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12872024-10-01T02:33:41.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12882024-10-01T02:33:41.072ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1274, tv_nsec: 515645577 } })
12892024-10-01T02:33:41.072ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
12902024-10-01T02:33:41.086ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
12912024-10-01T02:33:41.086ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12922024-10-01T02:33:41.086ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0a3f6d3-e9a9-44ca-8a2a-1d4c3ea9399f", "content-length": "26", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
12932024-10-01T02:33:41.086ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12942024-10-01T02:33:41.088ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12952024-10-01T02:33:41.097ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.018547ms iteration = 2 status = {"errors":[],"records_set_to_done":[]}
12962024-10-01T02:33:41.099ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12972024-10-01T02:33:41.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12982024-10-01T02:33:41.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12992024-10-01T02:33:41.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13002024-10-01T02:33:41.102ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13012024-10-01T02:33:41.102ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
13022024-10-01T02:33:41.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13032024-10-01T02:33:41.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13042024-10-01T02:33:41.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13052024-10-01T02:33:41.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13062024-10-01T02:33:41.106ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.421807ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13072024-10-01T02:33:41.107ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13082024-10-01T02:33:41.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13092024-10-01T02:33:41.112ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
13102024-10-01T02:33:41.112ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.138309ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
13112024-10-01T02:33:41.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13122024-10-01T02:33:41.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
13132024-10-01T02:33:41.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13142024-10-01T02:33:41.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13152024-10-01T02:33:41.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13162024-10-01T02:33:41.119ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13172024-10-01T02:33:41.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13182024-10-01T02:33:41.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13192024-10-01T02:33:41.134ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13202024-10-01T02:33:41.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
13212024-10-01T02:33:41.136ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13222024-10-01T02:33:41.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13232024-10-01T02:33:41.137ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 105.907025ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
13242024-10-01T02:33:41.139ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1274, tv_nsec: 583260590 } })
13252024-10-01T02:33:41.140ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
13262024-10-01T02:33:41.155ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 123.655593ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
13272024-10-01T02:33:41.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b1cea4c9-ec12-4882-84b5-e659fd344a06 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
13282024-10-01T02:33:41.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b1cea4c9-ec12-4882-84b5-e659fd344a06 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
13292024-10-01T02:33:41.163ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 131.527834ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
13302024-10-01T02:33:41.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b1cea4c9-ec12-4882-84b5-e659fd344a06 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
13312024-10-01T02:33:41.165ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
13322024-10-01T02:33:41.165ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13332024-10-01T02:33:41.165ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c98bfedb-c3ee-4dfd-a7af-8de09be657f4", "content-length": "26", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
13342024-10-01T02:33:41.165ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13352024-10-01T02:33:41.166ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13362024-10-01T02:33:41.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 138.646413ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
13372024-10-01T02:33:41.198ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13382024-10-01T02:33:41.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13392024-10-01T02:33:41.222ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13402024-10-01T02:33:41.222ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
13412024-10-01T02:33:41.222ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 190.297009ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
13422024-10-01T02:33:41.230ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13432024-10-01T02:33:41.231ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd4d81cc-7810-4d59-ab98-a450d1050a40", "content-length": "1", "date": "Tue, 01 Oct 2024 02:33:40 GMT"} })
13442024-10-01T02:33:41.232ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13452024-10-01T02:33:41.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13462024-10-01T02:33:41.247ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
13472024-10-01T02:33:41.247ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 215.892378ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
13482024-10-01T02:33:41.253ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
13492024-10-01T02:33:41.253ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13502024-10-01T02:33:41.254ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "52dcf112-4b84-42f1-b33e-7022ccb1eb90", "content-length": "26", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
13512024-10-01T02:33:41.254ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13522024-10-01T02:33:41.255ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
13532024-10-01T02:33:41.261ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 229.904423ms iteration = 4 status = {"physical_disks_added":0}
13542024-10-01T02:33:41.267ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 236.084647ms iteration = 2 status = {}
13552024-10-01T02:33:41.279ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13562024-10-01T02:33:41.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13572024-10-01T02:33:41.297ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13582024-10-01T02:33:41.297ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5dcaede6-6584-4916-b033-2d72503a7bc4", "content-length": "372", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
13592024-10-01T02:33:41.300ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13602024-10-01T02:33:41.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13612024-10-01T02:33:41.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13622024-10-01T02:33:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13632024-10-01T02:33:41.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13642024-10-01T02:33:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13652024-10-01T02:33:41.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13662024-10-01T02:33:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13672024-10-01T02:33:41.338ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13682024-10-01T02:33:41.338ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1081b86d-c140-4ddf-a68f-8184b045264f", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
13692024-10-01T02:33:41.338ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13702024-10-01T02:33:41.339ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 307.407951ms iteration = 2 status = {}
13712024-10-01T02:33:41.342ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
13722024-10-01T02:33:41.342ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13732024-10-01T02:33:41.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13742024-10-01T02:33:41.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13752024-10-01T02:33:41.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13762024-10-01T02:33:41.376ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13772024-10-01T02:33:41.377ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13782024-10-01T02:33:41.377ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13792024-10-01T02:33:41.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13802024-10-01T02:33:41.388ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13812024-10-01T02:33:41.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13822024-10-01T02:33:41.392ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
13832024-10-01T02:33:41.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13842024-10-01T02:33:41.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13852024-10-01T02:33:41.409ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 377.344383ms iteration = 2 status = null
13862024-10-01T02:33:41.411ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13872024-10-01T02:33:41.412ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13882024-10-01T02:33:41.412ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13892024-10-01T02:33:41.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13902024-10-01T02:33:41.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13912024-10-01T02:33:41.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13922024-10-01T02:33:41.503ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
13932024-10-01T02:33:41.504ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "70215e8f-8eb2-455e-87b6-7bd6e7ad910b", "content-length": "691", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
13942024-10-01T02:33:41.504ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
13952024-10-01T02:33:41.504ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
13962024-10-01T02:33:41.504ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
13972024-10-01T02:33:41.506ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 474.323548ms iteration = 2 status = {}
13982024-10-01T02:33:41.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13992024-10-01T02:33:41.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14002024-10-01T02:33:41.686ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14012024-10-01T02:33:41.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14022024-10-01T02:33:41.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14032024-10-01T02:33:41.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14042024-10-01T02:33:41.777ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
14052024-10-01T02:33:41.777ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "41dc0582-db23-413f-bfcf-1177c9b737bb", "content-length": "121", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
14062024-10-01T02:33:41.794ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
14072024-10-01T02:33:41.794ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
14082024-10-01T02:33:41.796ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14092024-10-01T02:33:41.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14102024-10-01T02:33:41.797ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14112024-10-01T02:33:41.797ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14122024-10-01T02:33:41.797ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
14132024-10-01T02:33:41.797ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
14142024-10-01T02:33:41.798ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
14152024-10-01T02:33:41.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14162024-10-01T02:33:41.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14172024-10-01T02:33:41.802ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
14182024-10-01T02:33:41.802ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b611b86-71c1-4ff7-af37-bd8c577e6668", "content-length": "2", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
14192024-10-01T02:33:41.802ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
14202024-10-01T02:33:41.802ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c41cb30e-e843-4cd6-ae52-42cda18e42c8", "content-length": "52", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
14212024-10-01T02:33:41.811ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
14222024-10-01T02:33:41.814ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14232024-10-01T02:33:41.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14242024-10-01T02:33:41.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14252024-10-01T02:33:41.914ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1275, tv_nsec: 357815599 } })
14262024-10-01T02:33:41.914ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1051
14272024-10-01T02:33:41.946ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
14282024-10-01T02:33:41.946ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14292024-10-01T02:33:41.947ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d3c6590-151f-469b-a795-087a73565782", "content-length": "26", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
14302024-10-01T02:33:41.947ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14312024-10-01T02:33:41.947ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14322024-10-01T02:33:41.977ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
14332024-10-01T02:33:41.977ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "22a3a2cf-1101-4b27-97a2-05d38b19ec8b", "content-length": "4", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
14342024-10-01T02:33:41.978ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 946.267576ms iteration = 2 status = 6
14352024-10-01T02:33:42.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 415d828d-f5cd-4f97-8730-f45f4d498de7 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14362024-10-01T02:33:42.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 415d828d-f5cd-4f97-8730-f45f4d498de7 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14372024-10-01T02:33:42.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 415d828d-f5cd-4f97-8730-f45f4d498de7 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14382024-10-01T02:33:42.277ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6a0f012e-72c1-4cc3-ae97-efd791eec186", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
14392024-10-01T02:33:42.277ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
14402024-10-01T02:33:42.277ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14412024-10-01T02:33:42.277ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "65268535-24a5-4136-8e14-87d1db590c84", "content-length": "667", "date": "Tue, 01 Oct 2024 02:33:42 GMT"} })
14422024-10-01T02:33:42.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14432024-10-01T02:33:42.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14442024-10-01T02:33:42.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14452024-10-01T02:33:42.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14462024-10-01T02:33:42.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14472024-10-01T02:33:42.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14482024-10-01T02:33:42.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14492024-10-01T02:33:42.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14502024-10-01T02:33:42.375ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 1.343437472s iteration = 2 status = {}
14512024-10-01T02:33:43.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 77fd3d6d-e0c0-489a-90be-17316b0cb8ee roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14522024-10-01T02:33:43.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 77fd3d6d-e0c0-489a-90be-17316b0cb8ee resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14532024-10-01T02:33:43.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 77fd3d6d-e0c0-489a-90be-17316b0cb8ee response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14542024-10-01T02:33:44.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0140d2df-94ac-4401-8d47-fda9fd8b7fea roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14552024-10-01T02:33:44.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0140d2df-94ac-4401-8d47-fda9fd8b7fea resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14562024-10-01T02:33:44.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0140d2df-94ac-4401-8d47-fda9fd8b7fea response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14572024-10-01T02:33:45.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4b731846-ba59-4c09-9a18-72a1c73478ed roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14582024-10-01T02:33:45.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4b731846-ba59-4c09-9a18-72a1c73478ed resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14592024-10-01T02:33:45.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2644 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4b731846-ba59-4c09-9a18-72a1c73478ed response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14602024-10-01T02:33:46.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 12d58415-3a60-45a3-97ce-27db25f22e06 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14612024-10-01T02:33:46.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 12d58415-3a60-45a3-97ce-27db25f22e06 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14622024-10-01T02:33:46.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 12d58415-3a60-45a3-97ce-27db25f22e06 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14632024-10-01T02:33:47.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 81740084-06e0-4e08-a54d-ff69a2c99bef roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14642024-10-01T02:33:47.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 81740084-06e0-4e08-a54d-ff69a2c99bef resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14652024-10-01T02:33:47.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 81740084-06e0-4e08-a54d-ff69a2c99bef response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14662024-10-01T02:33:48.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ff5a29a0-8829-4e23-b0f2-11aeabb1bf83 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14672024-10-01T02:33:48.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ff5a29a0-8829-4e23-b0f2-11aeabb1bf83 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14682024-10-01T02:33:48.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2756 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ff5a29a0-8829-4e23-b0f2-11aeabb1bf83 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14692024-10-01T02:33:49.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 24b949ed-2783-4ef1-91e1-b4ba571ab777 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14702024-10-01T02:33:49.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 24b949ed-2783-4ef1-91e1-b4ba571ab777 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14712024-10-01T02:33:49.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 24b949ed-2783-4ef1-91e1-b4ba571ab777 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14722024-10-01T02:33:50.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 35d5462d-820b-422b-a02e-6c2ca8ea43a0 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14732024-10-01T02:33:50.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 35d5462d-820b-422b-a02e-6c2ca8ea43a0 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14742024-10-01T02:33:50.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 35d5462d-820b-422b-a02e-6c2ca8ea43a0 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14752024-10-01T02:33:51.031ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
14762024-10-01T02:33:51.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14772024-10-01T02:33:51.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14782024-10-01T02:33:51.032ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
14792024-10-01T02:33:51.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14802024-10-01T02:33:51.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14812024-10-01T02:33:51.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14822024-10-01T02:33:51.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14832024-10-01T02:33:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14842024-10-01T02:33:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14852024-10-01T02:33:51.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14862024-10-01T02:33:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14872024-10-01T02:33:51.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14882024-10-01T02:33:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14892024-10-01T02:33:51.062ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.902071ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14902024-10-01T02:33:51.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14912024-10-01T02:33:51.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
14922024-10-01T02:33:51.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14932024-10-01T02:33:51.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14942024-10-01T02:33:51.075ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
14952024-10-01T02:33:51.075ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.645801ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
14962024-10-01T02:33:51.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 176f0b77-4d90-4519-8bd1-89ba2491c8b1 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14972024-10-01T02:33:51.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 176f0b77-4d90-4519-8bd1-89ba2491c8b1 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14982024-10-01T02:33:51.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1857 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 176f0b77-4d90-4519-8bd1-89ba2491c8b1 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
14992024-10-01T02:33:52.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 54d10d90-09f6-4361-84f8-b4a59e308f77 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15002024-10-01T02:33:52.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 54d10d90-09f6-4361-84f8-b4a59e308f77 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15012024-10-01T02:33:52.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 54d10d90-09f6-4361-84f8-b4a59e308f77 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15022024-10-01T02:33:53.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fb4e6f16-3b96-40e7-9167-d4eed8dc17c9 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15032024-10-01T02:33:53.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fb4e6f16-3b96-40e7-9167-d4eed8dc17c9 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15042024-10-01T02:33:53.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fb4e6f16-3b96-40e7-9167-d4eed8dc17c9 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15052024-10-01T02:33:54.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 10f6b075-19cf-4d35-8544-9aaa16253297 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15062024-10-01T02:33:54.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 10f6b075-19cf-4d35-8544-9aaa16253297 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15072024-10-01T02:33:54.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 10f6b075-19cf-4d35-8544-9aaa16253297 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15082024-10-01T02:33:55.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9d2b554b-32d9-409f-ac08-e1a3a6884eaf roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15092024-10-01T02:33:55.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9d2b554b-32d9-409f-ac08-e1a3a6884eaf resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15102024-10-01T02:33:55.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2566 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9d2b554b-32d9-409f-ac08-e1a3a6884eaf response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15112024-10-01T02:33:56.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 42b37f66-ecee-44a2-84aa-2b942767b366 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15122024-10-01T02:33:56.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 42b37f66-ecee-44a2-84aa-2b942767b366 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15132024-10-01T02:33:56.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2718 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 42b37f66-ecee-44a2-84aa-2b942767b366 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15142024-10-01T02:33:57.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 50d55bc3-baaa-4aff-959b-12db378a6453 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15152024-10-01T02:33:57.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 50d55bc3-baaa-4aff-959b-12db378a6453 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15162024-10-01T02:33:57.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 50d55bc3-baaa-4aff-959b-12db378a6453 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15172024-10-01T02:33:58.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4ff86f52-587b-445f-aa3e-a8a3f8ad652e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15182024-10-01T02:33:58.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4ff86f52-587b-445f-aa3e-a8a3f8ad652e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15192024-10-01T02:33:58.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1952 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4ff86f52-587b-445f-aa3e-a8a3f8ad652e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15202024-10-01T02:33:59.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = eeb42c04-83c4-40c0-ae08-9912e250b569 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15212024-10-01T02:33:59.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = eeb42c04-83c4-40c0-ae08-9912e250b569 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15222024-10-01T02:33:59.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = eeb42c04-83c4-40c0-ae08-9912e250b569 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15232024-10-01T02:34:00.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4727333a-c667-4eb5-a848-bdd54bc1af59 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15242024-10-01T02:34:00.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4727333a-c667-4eb5-a848-bdd54bc1af59 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15252024-10-01T02:34:00.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4727333a-c667-4eb5-a848-bdd54bc1af59 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15262024-10-01T02:34:01.031ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
15272024-10-01T02:34:01.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15282024-10-01T02:34:01.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15292024-10-01T02:34:01.031ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
15302024-10-01T02:34:01.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15312024-10-01T02:34:01.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15322024-10-01T02:34:01.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15332024-10-01T02:34:01.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15342024-10-01T02:34:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15352024-10-01T02:34:01.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15362024-10-01T02:34:01.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15372024-10-01T02:34:01.036ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.484255ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15382024-10-01T02:34:01.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15392024-10-01T02:34:01.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15402024-10-01T02:34:01.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15412024-10-01T02:34:01.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15422024-10-01T02:34:01.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
15432024-10-01T02:34:01.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15442024-10-01T02:34:01.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15452024-10-01T02:34:01.050ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
15462024-10-01T02:34:01.050ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.440826ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
15472024-10-01T02:34:01.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ad88a86f-2006-4f50-8d18-975fd53ebd90 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15482024-10-01T02:34:01.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ad88a86f-2006-4f50-8d18-975fd53ebd90 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15492024-10-01T02:34:01.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ad88a86f-2006-4f50-8d18-975fd53ebd90 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15502024-10-01T02:34:02.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9d2bc820-830c-46f6-a008-d8a62160c60c roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15512024-10-01T02:34:02.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9d2bc820-830c-46f6-a008-d8a62160c60c resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15522024-10-01T02:34:02.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9d2bc820-830c-46f6-a008-d8a62160c60c response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15532024-10-01T02:34:03.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2c878d99-e8c4-43c7-b8b4-7a1ddf8c2926 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15542024-10-01T02:34:03.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2c878d99-e8c4-43c7-b8b4-7a1ddf8c2926 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15552024-10-01T02:34:03.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2496 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2c878d99-e8c4-43c7-b8b4-7a1ddf8c2926 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15562024-10-01T02:34:04.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ec57557b-e12e-48b3-8e55-6b738de269db roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15572024-10-01T02:34:04.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ec57557b-e12e-48b3-8e55-6b738de269db resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15582024-10-01T02:34:04.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ec57557b-e12e-48b3-8e55-6b738de269db response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15592024-10-01T02:34:05.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f790eede-afac-4965-82b8-25708c2c0713 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15602024-10-01T02:34:05.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f790eede-afac-4965-82b8-25708c2c0713 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15612024-10-01T02:34:05.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f790eede-afac-4965-82b8-25708c2c0713 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15622024-10-01T02:34:06.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 679e22ba-a818-4c53-97eb-7a6cb12629df roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15632024-10-01T02:34:06.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 679e22ba-a818-4c53-97eb-7a6cb12629df resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15642024-10-01T02:34:06.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 679e22ba-a818-4c53-97eb-7a6cb12629df response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15652024-10-01T02:34:07.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d9a3d265-8986-4a07-bf40-13a3fc2dabf4 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15662024-10-01T02:34:07.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d9a3d265-8986-4a07-bf40-13a3fc2dabf4 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15672024-10-01T02:34:07.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2063 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d9a3d265-8986-4a07-bf40-13a3fc2dabf4 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15682024-10-01T02:34:08.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d808d881-a79f-4de1-ab1b-b990aa6908e7 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15692024-10-01T02:34:08.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d808d881-a79f-4de1-ab1b-b990aa6908e7 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15702024-10-01T02:34:08.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d808d881-a79f-4de1-ab1b-b990aa6908e7 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15712024-10-01T02:34:09.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d516f9c4-57fb-460a-b2f2-7f5a27201306 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15722024-10-01T02:34:09.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d516f9c4-57fb-460a-b2f2-7f5a27201306 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15732024-10-01T02:34:09.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d516f9c4-57fb-460a-b2f2-7f5a27201306 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15742024-10-01T02:34:10.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = aedbc75c-6af6-43bc-9f45-bce777544b96 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15752024-10-01T02:34:10.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = aedbc75c-6af6-43bc-9f45-bce777544b96 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15762024-10-01T02:34:10.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = aedbc75c-6af6-43bc-9f45-bce777544b96 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
15772024-10-01T02:34:11.031ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
15782024-10-01T02:34:11.031ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
15792024-10-01T02:34:11.031ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15802024-10-01T02:34:11.031ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
15812024-10-01T02:34:11.031ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
15822024-10-01T02:34:11.031ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
15832024-10-01T02:34:11.031ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
15842024-10-01T02:34:11.031ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 5.991\u{b5}s iteration = 3 status = {"error":"no config"}
15852024-10-01T02:34:11.031ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
15862024-10-01T02:34:11.031ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
15872024-10-01T02:34:11.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15882024-10-01T02:34:11.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15892024-10-01T02:34:11.031ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
15902024-10-01T02:34:11.031ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
15912024-10-01T02:34:11.031ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
15922024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
15932024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
15942024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15952024-10-01T02:34:11.032ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07
15962024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.58\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07"}
15972024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
15982024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
15992024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
16002024-10-01T02:34:11.032ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-01 02:24:11.031935592 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
16012024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16022024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
16032024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
16042024-10-01T02:34:11.032ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
16052024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 13.71\u{b5}s iteration = 3 status = {"error":"no config"}
16062024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
16072024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
16082024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
16092024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
16102024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
16112024-10-01T02:34:11.032ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
16122024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16132024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16142024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
16152024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
16162024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
16172024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16182024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16192024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
16202024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
16212024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16222024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16232024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
16242024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
16252024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
16262024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16272024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
16282024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16292024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
16302024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16312024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
16322024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16332024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
16342024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
16352024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
16362024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
16372024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
16382024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16392024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16402024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
16412024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16422024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16432024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
16442024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16452024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16462024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
16472024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16482024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16492024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
16502024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16512024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16522024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
16532024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16542024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16552024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16562024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16572024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16582024-10-01T02:34:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
16592024-10-01T02:34:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16602024-10-01T02:34:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
16612024-10-01T02:34:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16622024-10-01T02:34:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16632024-10-01T02:34:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16642024-10-01T02:34:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16652024-10-01T02:34:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
16662024-10-01T02:34:11.033ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16672024-10-01T02:34:11.033ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 476793926 } })
16682024-10-01T02:34:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16692024-10-01T02:34:11.033ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 476949839 } })
16702024-10-01T02:34:11.036ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
16712024-10-01T02:34:11.036ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.933773ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
16722024-10-01T02:34:11.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16732024-10-01T02:34:11.038ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
16742024-10-01T02:34:11.038ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.289956ms iteration = 2 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
16752024-10-01T02:34:11.038ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 481329932 } })
16762024-10-01T02:34:11.038ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 481572956 } })
16772024-10-01T02:34:11.039ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
16782024-10-01T02:34:11.039ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
16792024-10-01T02:34:11.040ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16802024-10-01T02:34:11.040ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.492242ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
16812024-10-01T02:34:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16822024-10-01T02:34:11.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16832024-10-01T02:34:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16842024-10-01T02:34:11.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16852024-10-01T02:34:11.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16862024-10-01T02:34:11.042ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16872024-10-01T02:34:11.042ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16882024-10-01T02:34:11.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16892024-10-01T02:34:11.043ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-01 02:24:11.031935592 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
16902024-10-01T02:34:11.043ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.667056ms iteration = 2 status = {"expiration":"2024-10-01T02:24:11.031935592Z","pruned":[]}
16912024-10-01T02:34:11.044ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16922024-10-01T02:34:11.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16932024-10-01T02:34:11.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16942024-10-01T02:34:11.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16952024-10-01T02:34:11.045ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16962024-10-01T02:34:11.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16972024-10-01T02:34:11.046ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16982024-10-01T02:34:11.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16992024-10-01T02:34:11.048ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17002024-10-01T02:34:11.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17012024-10-01T02:34:11.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17022024-10-01T02:34:11.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17032024-10-01T02:34:11.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17042024-10-01T02:34:11.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
17052024-10-01T02:34:11.049ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17062024-10-01T02:34:11.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17072024-10-01T02:34:11.056ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 24.390689ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
17082024-10-01T02:34:11.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17092024-10-01T02:34:11.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17102024-10-01T02:34:11.060ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17112024-10-01T02:34:11.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17122024-10-01T02:34:11.065ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17132024-10-01T02:34:11.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17142024-10-01T02:34:11.089ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17152024-10-01T02:34:11.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.48513ms iteration = 3 status = {"errors":[],"records_set_to_done":[]}
17162024-10-01T02:34:11.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
17172024-10-01T02:34:11.092ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17182024-10-01T02:34:11.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17192024-10-01T02:34:11.094ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17202024-10-01T02:34:11.095ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17212024-10-01T02:34:11.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17222024-10-01T02:34:11.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17232024-10-01T02:34:11.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17242024-10-01T02:34:11.099ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17252024-10-01T02:34:11.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
17262024-10-01T02:34:11.101ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17272024-10-01T02:34:11.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17282024-10-01T02:34:11.101ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.2457ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
17292024-10-01T02:34:11.101ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17302024-10-01T02:34:11.101ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17312024-10-01T02:34:11.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17322024-10-01T02:34:11.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17332024-10-01T02:34:11.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
17342024-10-01T02:34:11.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17352024-10-01T02:34:11.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17362024-10-01T02:34:11.104ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
17372024-10-01T02:34:11.104ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
17382024-10-01T02:34:11.104ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 72.066848ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
17392024-10-01T02:34:11.104ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17402024-10-01T02:34:11.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17412024-10-01T02:34:11.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17422024-10-01T02:34:11.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17432024-10-01T02:34:11.107ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17442024-10-01T02:34:11.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17452024-10-01T02:34:11.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17462024-10-01T02:34:11.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17472024-10-01T02:34:11.114ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17482024-10-01T02:34:11.114ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17492024-10-01T02:34:11.114ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17502024-10-01T02:34:11.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17512024-10-01T02:34:11.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17522024-10-01T02:34:11.117ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17532024-10-01T02:34:11.117ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17542024-10-01T02:34:11.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17552024-10-01T02:34:11.119ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.08248ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17562024-10-01T02:34:11.119ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17572024-10-01T02:34:11.119ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 562505232 } })
17582024-10-01T02:34:11.120ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
17592024-10-01T02:34:11.120ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17602024-10-01T02:34:11.120ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17612024-10-01T02:34:11.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17622024-10-01T02:34:11.122ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17632024-10-01T02:34:11.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17642024-10-01T02:34:11.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17652024-10-01T02:34:11.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17662024-10-01T02:34:11.135ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
17672024-10-01T02:34:11.135ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17682024-10-01T02:34:11.136ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0be725ee-5c2d-4e17-a6f0-81a565c76394", "content-length": "26", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
17692024-10-01T02:34:11.137ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17702024-10-01T02:34:11.138ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17712024-10-01T02:34:11.150ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17722024-10-01T02:34:11.153ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
17732024-10-01T02:34:11.153ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17742024-10-01T02:34:11.153ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
17752024-10-01T02:34:11.153ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 121.532396ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
17762024-10-01T02:34:11.153ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2df1148-06a6-4814-b123-925c85fab3ab", "content-length": "26", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
17772024-10-01T02:34:11.153ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17782024-10-01T02:34:11.153ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
17792024-10-01T02:34:11.153ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17802024-10-01T02:34:11.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17812024-10-01T02:34:11.155ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17822024-10-01T02:34:11.165ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 133.02388ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17832024-10-01T02:34:11.165ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17842024-10-01T02:34:11.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17852024-10-01T02:34:11.168ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
17862024-10-01T02:34:11.169ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
17872024-10-01T02:34:11.169ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 136.898124ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
17882024-10-01T02:34:11.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17892024-10-01T02:34:11.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
17902024-10-01T02:34:11.172ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
17912024-10-01T02:34:11.172ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 141.003882ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
17922024-10-01T02:34:11.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17932024-10-01T02:34:11.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17942024-10-01T02:34:11.177ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17952024-10-01T02:34:11.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17962024-10-01T02:34:11.180ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17972024-10-01T02:34:11.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
17982024-10-01T02:34:11.183ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17992024-10-01T02:34:11.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18002024-10-01T02:34:11.186ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 154.102413ms iteration = 3 status = 0
18012024-10-01T02:34:11.186ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
18022024-10-01T02:34:11.186ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
18032024-10-01T02:34:11.186ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
18042024-10-01T02:34:11.186ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
18052024-10-01T02:34:11.186ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
18062024-10-01T02:34:11.186ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
18072024-10-01T02:34:11.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18082024-10-01T02:34:11.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18092024-10-01T02:34:11.186ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 154.309175ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
18102024-10-01T02:34:11.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18112024-10-01T02:34:11.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18122024-10-01T02:34:11.187ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 155.041248ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
18132024-10-01T02:34:11.187ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18142024-10-01T02:34:11.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18152024-10-01T02:34:11.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18162024-10-01T02:34:11.192ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18172024-10-01T02:34:11.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18182024-10-01T02:34:11.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18192024-10-01T02:34:11.192ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18202024-10-01T02:34:11.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18212024-10-01T02:34:11.194ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
18222024-10-01T02:34:11.194ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 0 version = 2
18232024-10-01T02:34:11.194ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18242024-10-01T02:34:11.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18252024-10-01T02:34:11.195ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18262024-10-01T02:34:11.199ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18272024-10-01T02:34:11.199ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18282024-10-01T02:34:11.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18292024-10-01T02:34:11.206ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18302024-10-01T02:34:11.206ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
18312024-10-01T02:34:11.206ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 174.545135ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
18322024-10-01T02:34:11.214ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
18332024-10-01T02:34:11.214ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18342024-10-01T02:34:11.215ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "97552268-0301-42ee-93fc-b2284e0b70a3", "content-length": "26", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
18352024-10-01T02:34:11.215ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18362024-10-01T02:34:11.216ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
18372024-10-01T02:34:11.217ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18382024-10-01T02:34:11.219ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18392024-10-01T02:34:11.219ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18402024-10-01T02:34:11.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18412024-10-01T02:34:11.222ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 190.892779ms iteration = 3 status = {}
18422024-10-01T02:34:11.225ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18432024-10-01T02:34:11.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18442024-10-01T02:34:11.228ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
18452024-10-01T02:34:11.228ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
18462024-10-01T02:34:11.228ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18472024-10-01T02:34:11.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18482024-10-01T02:34:11.231ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
18492024-10-01T02:34:11.231ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e688a86b-761c-482a-b5e3-9cfd5e3a4e41", "content-length": "2", "date": "Tue, 01 Oct 2024 02:34:10 GMT"} })
18502024-10-01T02:34:11.233ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18512024-10-01T02:34:11.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18522024-10-01T02:34:11.245ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
18532024-10-01T02:34:11.245ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 212.950649ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
18542024-10-01T02:34:11.255ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 223.600227ms iteration = 5 status = {"physical_disks_added":0}
18552024-10-01T02:34:11.260ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18562024-10-01T02:34:11.262ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "366c69d3-18ab-4155-9724-044d7dca86dd", "content-length": "372", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
18572024-10-01T02:34:11.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18582024-10-01T02:34:11.262ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18592024-10-01T02:34:11.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18602024-10-01T02:34:11.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18612024-10-01T02:34:11.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18622024-10-01T02:34:11.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18632024-10-01T02:34:11.274ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 1 version = 2
18642024-10-01T02:34:11.274ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
18652024-10-01T02:34:11.274ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
18662024-10-01T02:34:11.274ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 242.633126ms iteration = 2 status = {"generation":2}
18672024-10-01T02:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
18682024-10-01T02:34:11.287ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-01T02:33:09.142901Z, time_modified: 2024-10-01T02:33:09.142901Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
18692024-10-01T02:34:11.287ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 256.01405ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]}},"default_endpoint":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
18702024-10-01T02:34:11.289ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 257.744689ms iteration = 3 status = null
18712024-10-01T02:34:11.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18722024-10-01T02:34:11.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18732024-10-01T02:34:11.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18742024-10-01T02:34:11.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18752024-10-01T02:34:11.297ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18762024-10-01T02:34:11.297ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b01380a0-8423-4a9e-9490-565815e89702", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
18772024-10-01T02:34:11.298ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 266.246541ms iteration = 3 status = {}
18782024-10-01T02:34:11.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18792024-10-01T02:34:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18802024-10-01T02:34:11.304ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18812024-10-01T02:34:11.306ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18822024-10-01T02:34:11.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18832024-10-01T02:34:11.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18842024-10-01T02:34:11.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18852024-10-01T02:34:11.310ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18862024-10-01T02:34:11.310ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18872024-10-01T02:34:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18882024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /
18892024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /access
18902024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /assets/{path}
18912024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/auth
18922024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/confirm
18932024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/success
18942024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/token
18952024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/verify
18962024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes
18972024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /experimental/v1/probes
18982024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /experimental/v1/probes/{probe}
18992024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes/{probe}
19002024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /images
19012024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login
19022024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/local
19032024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}
19042024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /login/{silo_name}/saml/{provider_name}
19052024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
19062024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /lookup/{path}
19072024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects/{path}
19082024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects-new
19092024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /settings/{path}
19102024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /system/{path}
19112024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /utilization
19122024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates
19132024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/certificates
19142024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/certificates/{certificate}
19152024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates/{certificate}
19162024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks
19172024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks
19182024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/disks/{disk}
19192024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}
19202024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write
19212024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-start
19222024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-stop
19232024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/finalize
19242024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}/metrics/{metric}
19252024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips
19262024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips
19272024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/floating-ips/{floating_ip}
19282024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips/{floating_ip}
19292024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/floating-ips/{floating_ip}
19302024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/attach
19312024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/detach
19322024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups
19332024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups/{group_id}
19342024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images
19352024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images
19362024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/images/{image}
19372024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images/{image}
19382024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/demote
19392024-10-01T02:34:11.334ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/promote
19402024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances
19412024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances
19422024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}
19432024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}
19442024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/disks
19452024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/attach
19462024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/detach
19472024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/external-ips
19482024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
19492024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
19502024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/reboot
19512024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console
19522024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console/stream
19532024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/ssh-public-keys
19542024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/start
19552024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/stop
19562024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools
19572024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools/{pool}
19582024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/login/{silo_name}/local
19592024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/logout
19602024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me
19612024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/groups
19622024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys
19632024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/me/ssh-keys
19642024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
19652024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys/{ssh_key}
19662024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/metrics/{metric_name}
19672024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces
19682024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/network-interfaces
19692024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/network-interfaces/{interface}
19702024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces/{interface}
19712024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/network-interfaces/{interface}
19722024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ping
19732024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/policy
19742024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/policy
19752024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects
19762024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/projects
19772024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/projects/{project}
19782024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}
19792024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}
19802024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}/policy
19812024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}/policy
19822024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots
19832024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/snapshots
19842024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/snapshots/{snapshot}
19852024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots/{snapshot}
19862024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks
19872024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks/{disk_id}
19882024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks
19892024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks/{rack_id}
19902024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds
19912024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/sleds
19922024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}
19932024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
19942024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
19952024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
19962024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds-uninitialized
19972024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port
19982024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
19992024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings
20002024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port/{port}/status
20012024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches
20022024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches/{switch_id}
20032024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers
20042024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users
20052024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
20062024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
20072024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/saml
20082024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers/saml/{provider}
20092024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools
20102024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools
20112024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}
20122024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}
20132024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}
20142024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/ranges
20152024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
20162024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
20172024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/silos
20182024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/silos
20192024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
20202024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
20212024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/utilization
20222024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service
20232024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service/ranges
20242024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/add
20252024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/remove
20262024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/metrics/{metric_name}
20272024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot
20282024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/address-lot
20292024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
20302024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
20312024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/allow-list
20322024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/allow-list
20332024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-disable
20342024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-enable
20352024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bfd-status
20362024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp
20372024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp
20382024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bgp
20392024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set
20402024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/bgp-announce-set
20412024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set}
20422024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement
20432024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-exported
20442024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-message-history
20452024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-routes-ipv4
20462024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-status
20472024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/loopback-address
20482024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/loopback-address
20492024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
20502024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/switch-port-settings
20512024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings
20522024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/switch-port-settings
20532024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings/{port}
20542024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/policy
20552024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/policy
20562024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles
20572024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles/{role_name}
20582024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silo-quotas
20592024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos
20602024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/silos
20612024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/silos/{silo}
20622024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}
20632024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/ip-pools
20642024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/policy
20652024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/policy
20662024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/quotas
20672024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/quotas
20682024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/update/repository
20692024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/update/repository/{system_version}
20702024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users
20712024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users/{user_id}
20722024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin
20732024-10-01T02:34:11.335ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin/{user}
20742024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos
20752024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos/{silo}
20762024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/timeseries/query
20772024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/timeseries/schema
20782024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/users
20792024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/utilization
20802024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-firewall-rules
20812024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-firewall-rules
20822024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes
20832024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-router-routes
20842024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-router-routes/{route}
20852024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes/{route}
20862024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-router-routes/{route}
20872024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers
20882024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-routers
20892024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-routers/{router}
20902024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers/{router}
20912024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-routers/{router}
20922024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets
20932024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-subnets
20942024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-subnets/{subnet}
20952024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}
20962024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-subnets/{subnet}
20972024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
20982024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs
20992024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpcs
21002024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpcs/{vpc}
21012024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs/{vpc}
21022024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpcs/{vpc}
21032024-10-01T02:34:11.336ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = 172.30.2.6:443
21042024-10-01T02:34:11.336ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.6:443
21052024-10-01T02:34:11.338ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
21062024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /
21072024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /access
21082024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /assets/{path}
21092024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/auth
21102024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/confirm
21112024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/success
21122024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/token
21132024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/verify
21142024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes
21152024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /experimental/v1/probes
21162024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /experimental/v1/probes/{probe}
21172024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes/{probe}
21182024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /images
21192024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login
21202024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/local
21212024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}
21222024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /login/{silo_name}/saml/{provider_name}
21232024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
21242024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /lookup/{path}
21252024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects/{path}
21262024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects-new
21272024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /settings/{path}
21282024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /system/{path}
21292024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /utilization
21302024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates
21312024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/certificates
21322024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/certificates/{certificate}
21332024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates/{certificate}
21342024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks
21352024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks
21362024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/disks/{disk}
21372024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}
21382024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write
21392024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start
21402024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop
21412024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/finalize
21422024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric}
21432024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips
21442024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips
21452024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/floating-ips/{floating_ip}
21462024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips/{floating_ip}
21472024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/floating-ips/{floating_ip}
21482024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach
21492024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach
21502024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups
21512024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups/{group_id}
21522024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images
21532024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images
21542024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/images/{image}
21552024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images/{image}
21562024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/demote
21572024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/promote
21582024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances
21592024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances
21602024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}
21612024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}
21622024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/disks
21632024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/attach
21642024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/detach
21652024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/external-ips
21662024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
21672024-10-01T02:34:11.342ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
21682024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/reboot
21692024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console
21702024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream
21712024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys
21722024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/start
21732024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/stop
21742024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools
21752024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools/{pool}
21762024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/login/{silo_name}/local
21772024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/logout
21782024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me
21792024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/groups
21802024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys
21812024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/me/ssh-keys
21822024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
21832024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key}
21842024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/metrics/{metric_name}
21852024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces
21862024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/network-interfaces
21872024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/network-interfaces/{interface}
21882024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces/{interface}
21892024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/network-interfaces/{interface}
21902024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ping
21912024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/policy
21922024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/policy
21932024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects
21942024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/projects
21952024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/projects/{project}
21962024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}
21972024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}
21982024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}/policy
21992024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}/policy
22002024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots
22012024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/snapshots
22022024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/snapshots/{snapshot}
22032024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots/{snapshot}
22042024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks
22052024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks/{disk_id}
22062024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks
22072024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks/{rack_id}
22082024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds
22092024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/sleds
22102024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}
22112024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
22122024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
22132024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
22142024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized
22152024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port
22162024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
22172024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings
22182024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status
22192024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches
22202024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches/{switch_id}
22212024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers
22222024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users
22232024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
22242024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
22252024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/saml
22262024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers/saml/{provider}
22272024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools
22282024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools
22292024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}
22302024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}
22312024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}
22322024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges
22332024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
22342024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
22352024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos
22362024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos
22372024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
22382024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
22392024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization
22402024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service
22412024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service/ranges
22422024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add
22432024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove
22442024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/metrics/{metric_name}
22452024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot
22462024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/address-lot
22472024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
22482024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
22492024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/allow-list
22502024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/allow-list
22512024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-disable
22522024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-enable
22532024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bfd-status
22542024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp
22552024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp
22562024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bgp
22572024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set
22582024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/bgp-announce-set
22592024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set}
22602024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement
22612024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-exported
22622024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-message-history
22632024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4
22642024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-status
22652024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/loopback-address
22662024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/loopback-address
22672024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
22682024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/switch-port-settings
22692024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings
22702024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/switch-port-settings
22712024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port}
22722024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/policy
22732024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/policy
22742024-10-01T02:34:11.343ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles
22752024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles/{role_name}
22762024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silo-quotas
22772024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos
22782024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/silos
22792024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/silos/{silo}
22802024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}
22812024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools
22822024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/policy
22832024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/policy
22842024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/quotas
22852024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/quotas
22862024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/update/repository
22872024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/update/repository/{system_version}
22882024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users
22892024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users/{user_id}
22902024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin
22912024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin/{user}
22922024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos
22932024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos/{silo}
22942024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/timeseries/query
22952024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/timeseries/schema
22962024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/users
22972024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/utilization
22982024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-firewall-rules
22992024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-firewall-rules
23002024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes
23012024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-router-routes
23022024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-router-routes/{route}
23032024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes/{route}
23042024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-router-routes/{route}
23052024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers
23062024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-routers
23072024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-routers/{router}
23082024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers/{router}
23092024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-routers/{router}
23102024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets
23112024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-subnets
23122024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-subnets/{subnet}
23132024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}
23142024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-subnets/{subnet}
23152024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
23162024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs
23172024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpcs
23182024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpcs/{vpc}
23192024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs/{vpc}
23202024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpcs/{vpc}
23212024-10-01T02:34:11.345ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::b]:12228
23222024-10-01T02:34:11.345ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12228
23232024-10-01T02:34:11.350ZDEBGnexus (nexus-producer-server): registered DTrace probes
23242024-10-01T02:34:11.367ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::b]:42426 method = GET path = /{producer_id}
23252024-10-01T02:34:11.367ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::b]:42426
23262024-10-01T02:34:11.367ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:42426
23272024-10-01T02:34:11.367ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::b]:42426
23282024-10-01T02:34:11.367ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::b]:12221
23292024-10-01T02:34:11.367ZDEBGnexus (nexus-producer-server): starting producer registration task
23302024-10-01T02:34:11.372ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::b]:42426 file = oximeter/producer/src/lib.rs:283 interval = 10s producer_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
23312024-10-01T02:34:11.372ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
23322024-10-01T02:34:11.372ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
23332024-10-01T02:34:11.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23342024-10-01T02:34:11.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23352024-10-01T02:34:11.396ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
23362024-10-01T02:34:11.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23372024-10-01T02:34:11.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23382024-10-01T02:34:11.406ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
23392024-10-01T02:34:11.406ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d556d692-0e0f-4f61-9396-345999bd3f35", "content-length": "121", "date": "Tue, 01 Oct 2024 02:34:10 GMT"} })
23402024-10-01T02:34:11.406ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
23412024-10-01T02:34:11.406ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
23422024-10-01T02:34:11.407ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
23432024-10-01T02:34:11.407ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
23442024-10-01T02:34:11.407ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
23452024-10-01T02:34:11.407ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
23462024-10-01T02:34:11.407ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
23472024-10-01T02:34:11.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23482024-10-01T02:34:11.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23492024-10-01T02:34:11.409ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
23502024-10-01T02:34:11.409ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6688dce-4149-4ce3-a673-52fd0e16a97e", "content-length": "2", "date": "Tue, 01 Oct 2024 02:34:10 GMT"} })
23512024-10-01T02:34:11.409ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
23522024-10-01T02:34:11.409ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "73e42b1d-16be-4992-a2eb-ff13da76c332", "content-length": "52", "date": "Tue, 01 Oct 2024 02:34:10 GMT"} })
23532024-10-01T02:34:11.409ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
23542024-10-01T02:34:11.409ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
23552024-10-01T02:34:11.427ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
23562024-10-01T02:34:11.427ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
23572024-10-01T02:34:11.427ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
23582024-10-01T02:34:11.427ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 395.389236ms iteration = 2 status = {"generation":1}
23592024-10-01T02:34:11.427ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
23602024-10-01T02:34:11.429ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
23612024-10-01T02:34:11.429ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e247dd09-6fda-43fa-bcbc-cb71eb19526f", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23622024-10-01T02:34:11.429ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23632024-10-01T02:34:11.431ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "16d15b9a-e1e3-4b4f-8274-648fde91f832", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23642024-10-01T02:34:11.431ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23652024-10-01T02:34:11.432ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23662024-10-01T02:34:11.432ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 158.384524ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
23672024-10-01T02:34:11.463ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23682024-10-01T02:34:11.465ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
23692024-10-01T02:34:11.465ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:61034
23702024-10-01T02:34:11.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61034 req_id = d1f9bb4f-6689-4e90-b507-9a7693649c2f roles = RoleSet { roles: {} } uri = /metrics/producers
23712024-10-01T02:34:11.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61034 req_id = d1f9bb4f-6689-4e90-b507-9a7693649c2f resource = Database result = Ok(()) uri = /metrics/producers
23722024-10-01T02:34:11.482ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
23732024-10-01T02:34:11.513ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "916ca256-e652-4d17-9863-3d682cf489b4", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
23742024-10-01T02:34:11.513ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
23752024-10-01T02:34:11.513ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
23762024-10-01T02:34:11.514ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4004c493-6d0f-42eb-9e7d-f55da13358bb", "content-length": "667", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
23772024-10-01T02:34:11.514ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23782024-10-01T02:34:11.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23792024-10-01T02:34:11.515ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffc090ad-0218-466e-acc3-a412cf6eb110", "content-length": "691", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
23802024-10-01T02:34:11.515ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
23812024-10-01T02:34:11.515ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
23822024-10-01T02:34:11.515ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
23832024-10-01T02:34:11.517ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 484.862345ms iteration = 3 status = {}
23842024-10-01T02:34:11.518ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23852024-10-01T02:34:11.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23862024-10-01T02:34:11.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23872024-10-01T02:34:11.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23882024-10-01T02:34:11.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23892024-10-01T02:34:11.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23902024-10-01T02:34:11.554ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 522.331422ms iteration = 3 status = {}
23912024-10-01T02:34:11.564ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
23922024-10-01T02:34:11.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61034 req_id = d1f9bb4f-6689-4e90-b507-9a7693649c2f roles = RoleSet { roles: {} } uri = /metrics/producers
23932024-10-01T02:34:11.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61034 req_id = d1f9bb4f-6689-4e90-b507-9a7693649c2f resource = Database result = Ok(()) uri = /metrics/producers
23942024-10-01T02:34:11.574ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
23952024-10-01T02:34:11.619ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
23962024-10-01T02:34:11.620ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "626db664-c88e-43ff-a492-30bed2d9a389", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23972024-10-01T02:34:11.620ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23982024-10-01T02:34:11.621ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "fdda6cf4-a8f2-4242-8077-f86433b6049d", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23992024-10-01T02:34:11.621ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24002024-10-01T02:34:11.624ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fbcc4cee-b549-4ec7-8267-99387133a2ed", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24012024-10-01T02:34:11.624ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24022024-10-01T02:34:11.625ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24032024-10-01T02:34:11.625ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 198.498806ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
24042024-10-01T02:34:11.637ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
24052024-10-01T02:34:11.638ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "010ee928-0d21-4bd4-9a56-f6cb40951acc", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
24062024-10-01T02:34:11.638ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
24072024-10-01T02:34:11.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 176508 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61034 req_id = d1f9bb4f-6689-4e90-b507-9a7693649c2f response_code = 201 uri = /metrics/producers
24082024-10-01T02:34:11.642ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "d1f9bb4f-6689-4e90-b507-9a7693649c2f", "content-length": "41", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
24092024-10-01T02:34:11.644ZDEBGnexus (producer-registration-task): registered with nexus successfully
24102024-10-01T02:34:11.644ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
24112024-10-01T02:34:11.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dff58966-531e-4906-87c7-de91a322c043 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24122024-10-01T02:34:11.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dff58966-531e-4906-87c7-de91a322c043 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24132024-10-01T02:34:11.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dff58966-531e-4906-87c7-de91a322c043 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24142024-10-01T02:34:12.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = deb7683e-2c64-46ae-830c-2c6de885c5b5 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24152024-10-01T02:34:12.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = deb7683e-2c64-46ae-830c-2c6de885c5b5 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24162024-10-01T02:34:12.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = deb7683e-2c64-46ae-830c-2c6de885c5b5 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24172024-10-01T02:34:13.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7f66f7a5-e3f6-4b20-8ec2-5645d51a3a9d roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24182024-10-01T02:34:13.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7f66f7a5-e3f6-4b20-8ec2-5645d51a3a9d resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24192024-10-01T02:34:13.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7f66f7a5-e3f6-4b20-8ec2-5645d51a3a9d response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24202024-10-01T02:34:14.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 66db9a1a-94cd-4644-aa12-59c3a0ad2092 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24212024-10-01T02:34:14.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 66db9a1a-94cd-4644-aa12-59c3a0ad2092 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24222024-10-01T02:34:14.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 66db9a1a-94cd-4644-aa12-59c3a0ad2092 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24232024-10-01T02:34:15.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b0052b93-e23e-405e-896d-7da3838a2b1f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24242024-10-01T02:34:15.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b0052b93-e23e-405e-896d-7da3838a2b1f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24252024-10-01T02:34:15.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b0052b93-e23e-405e-896d-7da3838a2b1f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24262024-10-01T02:34:16.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a5cb5628-fc7b-4d15-ae9e-7ce7e189f67d roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24272024-10-01T02:34:16.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a5cb5628-fc7b-4d15-ae9e-7ce7e189f67d resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24282024-10-01T02:34:16.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a5cb5628-fc7b-4d15-ae9e-7ce7e189f67d response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24292024-10-01T02:34:17.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4b46a648-4762-4772-8fe6-144c7d29c53e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24302024-10-01T02:34:17.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4b46a648-4762-4772-8fe6-144c7d29c53e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24312024-10-01T02:34:17.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4b46a648-4762-4772-8fe6-144c7d29c53e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24322024-10-01T02:34:18.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b94bd71d-edfc-4823-90b5-858e68fc0a37 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24332024-10-01T02:34:18.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b94bd71d-edfc-4823-90b5-858e68fc0a37 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24342024-10-01T02:34:18.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b94bd71d-edfc-4823-90b5-858e68fc0a37 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24352024-10-01T02:34:20.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d9ce80f0-099d-45b0-a257-909c9f770259 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24362024-10-01T02:34:20.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d9ce80f0-099d-45b0-a257-909c9f770259 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24372024-10-01T02:34:20.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d9ce80f0-099d-45b0-a257-909c9f770259 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24382024-10-01T02:34:21.031ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
24392024-10-01T02:34:21.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24402024-10-01T02:34:21.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24412024-10-01T02:34:21.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f6672699-328c-43ed-af6d-c741a7da2e9d roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24422024-10-01T02:34:21.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f6672699-328c-43ed-af6d-c741a7da2e9d resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24432024-10-01T02:34:21.032ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
24442024-10-01T02:34:21.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24452024-10-01T02:34:21.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24462024-10-01T02:34:21.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24472024-10-01T02:34:21.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f6672699-328c-43ed-af6d-c741a7da2e9d response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24482024-10-01T02:34:21.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24492024-10-01T02:34:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24502024-10-01T02:34:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24512024-10-01T02:34:21.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24522024-10-01T02:34:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24532024-10-01T02:34:21.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24542024-10-01T02:34:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24552024-10-01T02:34:21.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24562024-10-01T02:34:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
24572024-10-01T02:34:21.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24582024-10-01T02:34:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24592024-10-01T02:34:21.050ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
24602024-10-01T02:34:21.050ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.06494ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
24612024-10-01T02:34:21.062ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.549522ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24622024-10-01T02:34:21.674ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:42426 remote_addr = [fd00:1122:3344:101::d]:63725
24632024-10-01T02:34:21.684ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10315 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 7f4559b6-fb02-4d39-b635-9ce4bc0ea7c5 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
24642024-10-01T02:34:22.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cf6e955b-d92c-4d7c-aa0a-177435024349 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24652024-10-01T02:34:22.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cf6e955b-d92c-4d7c-aa0a-177435024349 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24662024-10-01T02:34:22.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cf6e955b-d92c-4d7c-aa0a-177435024349 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24672024-10-01T02:34:23.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 31662b93-6d0f-4c17-bfc6-17505eba5865 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24682024-10-01T02:34:23.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 31662b93-6d0f-4c17-bfc6-17505eba5865 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24692024-10-01T02:34:23.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 31662b93-6d0f-4c17-bfc6-17505eba5865 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24702024-10-01T02:34:24.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 83b53ae1-1f2e-4124-950f-4e29ed3ae68f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24712024-10-01T02:34:24.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 83b53ae1-1f2e-4124-950f-4e29ed3ae68f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24722024-10-01T02:34:24.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 83b53ae1-1f2e-4124-950f-4e29ed3ae68f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24732024-10-01T02:34:25.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2c08e737-e726-4f94-98fd-145574c2f11f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24742024-10-01T02:34:25.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2c08e737-e726-4f94-98fd-145574c2f11f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24752024-10-01T02:34:25.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2c08e737-e726-4f94-98fd-145574c2f11f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24762024-10-01T02:34:26.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f5491224-be5f-4424-9580-85f0ec23e31c roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24772024-10-01T02:34:26.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f5491224-be5f-4424-9580-85f0ec23e31c resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24782024-10-01T02:34:26.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f5491224-be5f-4424-9580-85f0ec23e31c response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24792024-10-01T02:34:27.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dc3832c3-f4d0-4ff7-a10f-ec6209dca3a5 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24802024-10-01T02:34:27.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dc3832c3-f4d0-4ff7-a10f-ec6209dca3a5 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24812024-10-01T02:34:27.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2668 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dc3832c3-f4d0-4ff7-a10f-ec6209dca3a5 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24822024-10-01T02:34:28.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8c52e031-ecba-4b36-a2e2-7477eb4f0b98 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24832024-10-01T02:34:28.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8c52e031-ecba-4b36-a2e2-7477eb4f0b98 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24842024-10-01T02:34:28.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8c52e031-ecba-4b36-a2e2-7477eb4f0b98 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24852024-10-01T02:34:29.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fb6bb80d-b2ca-49bf-8d3e-99e857d1f739 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24862024-10-01T02:34:29.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fb6bb80d-b2ca-49bf-8d3e-99e857d1f739 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24872024-10-01T02:34:29.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fb6bb80d-b2ca-49bf-8d3e-99e857d1f739 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24882024-10-01T02:34:30.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3a5661b8-9ba4-4e65-b930-e62f535eae8c roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24892024-10-01T02:34:30.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3a5661b8-9ba4-4e65-b930-e62f535eae8c resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24902024-10-01T02:34:30.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3a5661b8-9ba4-4e65-b930-e62f535eae8c response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
24912024-10-01T02:34:31.032ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
24922024-10-01T02:34:31.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24932024-10-01T02:34:31.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24942024-10-01T02:34:31.032ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
24952024-10-01T02:34:31.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24962024-10-01T02:34:31.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24972024-10-01T02:34:31.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24982024-10-01T02:34:31.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24992024-10-01T02:34:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25002024-10-01T02:34:31.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.289315ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25012024-10-01T02:34:31.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25022024-10-01T02:34:31.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25032024-10-01T02:34:31.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25042024-10-01T02:34:31.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25052024-10-01T02:34:31.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25062024-10-01T02:34:31.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25072024-10-01T02:34:31.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
25082024-10-01T02:34:31.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25092024-10-01T02:34:31.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25102024-10-01T02:34:31.049ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
25112024-10-01T02:34:31.049ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.966054ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
25122024-10-01T02:34:31.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 56022017-8e63-4efc-935f-597e510ef11e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25132024-10-01T02:34:31.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 56022017-8e63-4efc-935f-597e510ef11e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25142024-10-01T02:34:31.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1802 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 56022017-8e63-4efc-935f-597e510ef11e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25152024-10-01T02:34:31.674ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 383 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = bf24db40-3281-4421-87c8-2ba86cbe2ea1 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
25162024-10-01T02:34:32.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3a5a2508-2379-4595-9ba6-a552daccb559 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25172024-10-01T02:34:32.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3a5a2508-2379-4595-9ba6-a552daccb559 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25182024-10-01T02:34:32.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3a5a2508-2379-4595-9ba6-a552daccb559 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25192024-10-01T02:34:33.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 57ff6c93-21ad-48b6-9e0c-f22345123c6c roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25202024-10-01T02:34:33.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 57ff6c93-21ad-48b6-9e0c-f22345123c6c resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25212024-10-01T02:34:33.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 57ff6c93-21ad-48b6-9e0c-f22345123c6c response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25222024-10-01T02:34:34.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4c076612-24bd-4877-af3f-66dd706bf6a5 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25232024-10-01T02:34:34.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4c076612-24bd-4877-af3f-66dd706bf6a5 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25242024-10-01T02:34:34.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4c076612-24bd-4877-af3f-66dd706bf6a5 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25252024-10-01T02:34:35.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4add9e85-7b3a-44fb-8733-5639577be9c2 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25262024-10-01T02:34:35.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4add9e85-7b3a-44fb-8733-5639577be9c2 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25272024-10-01T02:34:35.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4add9e85-7b3a-44fb-8733-5639577be9c2 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25282024-10-01T02:34:36.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2bd3d07d-28b7-44a7-a209-1abd424f04a8 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25292024-10-01T02:34:36.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2bd3d07d-28b7-44a7-a209-1abd424f04a8 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25302024-10-01T02:34:36.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1879 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2bd3d07d-28b7-44a7-a209-1abd424f04a8 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25312024-10-01T02:34:37.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e28f0832-3076-42fc-9f10-74adf643c076 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25322024-10-01T02:34:37.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e28f0832-3076-42fc-9f10-74adf643c076 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25332024-10-01T02:34:37.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e28f0832-3076-42fc-9f10-74adf643c076 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25342024-10-01T02:34:38.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 941cee4d-1288-488d-a4e9-a3d2048e9a70 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25352024-10-01T02:34:38.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 941cee4d-1288-488d-a4e9-a3d2048e9a70 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25362024-10-01T02:34:38.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 941cee4d-1288-488d-a4e9-a3d2048e9a70 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25372024-10-01T02:34:39.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ed1552bc-d3fe-42d9-bb77-399c6218fcc0 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25382024-10-01T02:34:39.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ed1552bc-d3fe-42d9-bb77-399c6218fcc0 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25392024-10-01T02:34:39.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ed1552bc-d3fe-42d9-bb77-399c6218fcc0 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25402024-10-01T02:34:40.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dd4dfb99-2e66-491e-af5d-d4e3c48ddd2f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25412024-10-01T02:34:40.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dd4dfb99-2e66-491e-af5d-d4e3c48ddd2f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25422024-10-01T02:34:40.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dd4dfb99-2e66-491e-af5d-d4e3c48ddd2f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
25432024-10-01T02:34:41.031ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
25442024-10-01T02:34:41.031ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25452024-10-01T02:34:41.031ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
25462024-10-01T02:34:41.031ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
25472024-10-01T02:34:41.031ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
25482024-10-01T02:34:41.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25492024-10-01T02:34:41.032ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
25502024-10-01T02:34:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25512024-10-01T02:34:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25522024-10-01T02:34:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
25532024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
25542024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
25552024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
25562024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
25572024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25582024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
25592024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
25602024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
25612024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25622024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25632024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
25642024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25652024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
25662024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
25672024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25682024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25692024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
25702024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25712024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
25722024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25732024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
25742024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25752024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
25762024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25772024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
25782024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
25792024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25802024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
25812024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
25822024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25832024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25842024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25852024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25862024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25872024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25882024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25892024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25902024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25912024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25922024-10-01T02:34:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25932024-10-01T02:34:41.036ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.554866ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
25942024-10-01T02:34:41.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25952024-10-01T02:34:41.037ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1334, tv_nsec: 480529119 } })
25962024-10-01T02:34:41.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.694988ms iteration = 4 status = {"errors":[],"records_set_to_done":[]}
25972024-10-01T02:34:41.038ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
25982024-10-01T02:34:41.039ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25992024-10-01T02:34:41.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26002024-10-01T02:34:41.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26012024-10-01T02:34:41.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26022024-10-01T02:34:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26032024-10-01T02:34:41.041ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26042024-10-01T02:34:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26052024-10-01T02:34:41.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26062024-10-01T02:34:41.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26072024-10-01T02:34:41.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26082024-10-01T02:34:41.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26092024-10-01T02:34:41.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26102024-10-01T02:34:41.043ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26112024-10-01T02:34:41.045ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26122024-10-01T02:34:41.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26132024-10-01T02:34:41.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26142024-10-01T02:34:41.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26152024-10-01T02:34:41.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
26162024-10-01T02:34:41.046ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26172024-10-01T02:34:41.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26182024-10-01T02:34:41.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26192024-10-01T02:34:41.047ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1334, tv_nsec: 490173990 } })
26202024-10-01T02:34:41.048ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26212024-10-01T02:34:41.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26222024-10-01T02:34:41.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26232024-10-01T02:34:41.049ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
26242024-10-01T02:34:41.049ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26252024-10-01T02:34:41.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 16.441976ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26262024-10-01T02:34:41.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26272024-10-01T02:34:41.050ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1334, tv_nsec: 492970937 } })
26282024-10-01T02:34:41.051ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
26292024-10-01T02:34:41.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
26302024-10-01T02:34:41.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26312024-10-01T02:34:41.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26322024-10-01T02:34:41.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26332024-10-01T02:34:41.055ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26342024-10-01T02:34:41.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26352024-10-01T02:34:41.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
26362024-10-01T02:34:41.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26372024-10-01T02:34:41.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26382024-10-01T02:34:41.074ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
26392024-10-01T02:34:41.074ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.088975ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
26402024-10-01T02:34:41.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.573898ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
26412024-10-01T02:34:41.091ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26422024-10-01T02:34:41.091ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
26432024-10-01T02:34:41.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26442024-10-01T02:34:41.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26452024-10-01T02:34:41.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26462024-10-01T02:34:41.097ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26472024-10-01T02:34:41.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26482024-10-01T02:34:41.098ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26492024-10-01T02:34:41.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26502024-10-01T02:34:41.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26512024-10-01T02:34:41.101ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 68.252434ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26522024-10-01T02:34:41.103ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26532024-10-01T02:34:41.103ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
26542024-10-01T02:34:41.103ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 70.259768ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
26552024-10-01T02:34:41.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26562024-10-01T02:34:41.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26572024-10-01T02:34:41.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26582024-10-01T02:34:41.108ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26592024-10-01T02:34:41.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26602024-10-01T02:34:41.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26612024-10-01T02:34:41.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26622024-10-01T02:34:41.113ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26632024-10-01T02:34:41.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26642024-10-01T02:34:41.114ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26652024-10-01T02:34:41.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26662024-10-01T02:34:41.127ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
26672024-10-01T02:34:41.127ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26682024-10-01T02:34:41.127ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9abeba55-1bb7-4533-8877-2cc841340d71", "content-length": "26", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
26692024-10-01T02:34:41.127ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26702024-10-01T02:34:41.129ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26712024-10-01T02:34:41.141ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26722024-10-01T02:34:41.141ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
26732024-10-01T02:34:41.141ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26742024-10-01T02:34:41.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26752024-10-01T02:34:41.149ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26762024-10-01T02:34:41.149ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 116.675635ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
26772024-10-01T02:34:41.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
26782024-10-01T02:34:41.152ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26792024-10-01T02:34:41.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26802024-10-01T02:34:41.154ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 120.768584ms iteration = 4 status = 0
26812024-10-01T02:34:41.157ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26822024-10-01T02:34:41.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26832024-10-01T02:34:41.160ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 127.331354ms iteration = 6 status = {"physical_disks_added":0}
26842024-10-01T02:34:41.177ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26852024-10-01T02:34:41.177ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
26862024-10-01T02:34:41.177ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 144.129916ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
26872024-10-01T02:34:41.194ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 161.13528ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
26882024-10-01T02:34:41.195ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26892024-10-01T02:34:41.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26902024-10-01T02:34:41.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26912024-10-01T02:34:41.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26922024-10-01T02:34:41.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26932024-10-01T02:34:41.232ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26942024-10-01T02:34:41.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26952024-10-01T02:34:41.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26962024-10-01T02:34:41.238ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
26972024-10-01T02:34:41.238ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26982024-10-01T02:34:41.239ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a627370-05ba-4789-955f-910937b40131", "content-length": "26", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
26992024-10-01T02:34:41.239ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27002024-10-01T02:34:41.241ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
27012024-10-01T02:34:41.242ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27022024-10-01T02:34:41.242ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3d97a49-0b80-40da-883c-33d6b21f53af", "content-length": "2", "date": "Tue, 01 Oct 2024 02:34:40 GMT"} })
27032024-10-01T02:34:41.243ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27042024-10-01T02:34:41.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27052024-10-01T02:34:41.253ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
27062024-10-01T02:34:41.254ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27072024-10-01T02:34:41.254ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "79fd7b8b-a5c6-496b-b958-2c9bf01523a5", "content-length": "26", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
27082024-10-01T02:34:41.254ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27092024-10-01T02:34:41.256ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27102024-10-01T02:34:41.266ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27112024-10-01T02:34:41.267ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5c996f4-987e-4cfa-ba46-ab036d99fb1f", "content-length": "372", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
27122024-10-01T02:34:41.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27132024-10-01T02:34:41.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27142024-10-01T02:34:41.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27152024-10-01T02:34:41.269ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 237.475229ms iteration = 4 status = null
27162024-10-01T02:34:41.269ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27172024-10-01T02:34:41.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27182024-10-01T02:34:41.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27192024-10-01T02:34:41.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27202024-10-01T02:34:41.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27212024-10-01T02:34:41.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27222024-10-01T02:34:41.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27232024-10-01T02:34:41.276ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27242024-10-01T02:34:41.276ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bce761bd-de58-4ab3-b0a4-585e4ab9a423", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
27252024-10-01T02:34:41.277ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 244.146641ms iteration = 4 status = {}
27262024-10-01T02:34:41.324ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 292.769726ms iteration = 4 status = {}
27272024-10-01T02:34:41.343ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
27282024-10-01T02:34:41.344ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c95d93b-3640-49ed-8243-931170a9c07b", "content-length": "691", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
27292024-10-01T02:34:41.344ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
27302024-10-01T02:34:41.344ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
27312024-10-01T02:34:41.344ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
27322024-10-01T02:34:41.346ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 313.214529ms iteration = 4 status = {}
27332024-10-01T02:34:41.387ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27342024-10-01T02:34:41.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27352024-10-01T02:34:41.390ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
27362024-10-01T02:34:41.390ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27372024-10-01T02:34:41.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27382024-10-01T02:34:41.399ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
27392024-10-01T02:34:41.399ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d49aaff3-5f6a-44f8-aff6-23cbcba9d73c", "content-length": "121", "date": "Tue, 01 Oct 2024 02:34:40 GMT"} })
27402024-10-01T02:34:41.399ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
27412024-10-01T02:34:41.399ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
27422024-10-01T02:34:41.399ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27432024-10-01T02:34:41.399ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27442024-10-01T02:34:41.399ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
27452024-10-01T02:34:41.399ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
27462024-10-01T02:34:41.399ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
27472024-10-01T02:34:41.399ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27482024-10-01T02:34:41.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27492024-10-01T02:34:41.409ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27502024-10-01T02:34:41.409ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf48b056-c0b6-4da9-8632-039aed4d6042", "content-length": "2", "date": "Tue, 01 Oct 2024 02:34:40 GMT"} })
27512024-10-01T02:34:41.409ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27522024-10-01T02:34:41.409ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "af071d3a-2f17-40b2-9281-50cf2bae8ba1", "content-length": "52", "date": "Tue, 01 Oct 2024 02:34:40 GMT"} })
27532024-10-01T02:34:41.409ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
27542024-10-01T02:34:41.409ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27552024-10-01T02:34:41.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c81bed94-6381-4de5-8ba3-24d0173d6c15 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27562024-10-01T02:34:41.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c81bed94-6381-4de5-8ba3-24d0173d6c15 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27572024-10-01T02:34:41.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c81bed94-6381-4de5-8ba3-24d0173d6c15 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27582024-10-01T02:34:41.615ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "848fd110-cb01-471f-9f69-37e7723055bf", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
27592024-10-01T02:34:41.615ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
27602024-10-01T02:34:41.615ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27612024-10-01T02:34:41.616ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d74b5ac4-00df-4bcb-b260-64f97d1506d1", "content-length": "667", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
27622024-10-01T02:34:41.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27632024-10-01T02:34:41.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27642024-10-01T02:34:41.620ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27652024-10-01T02:34:41.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27662024-10-01T02:34:41.623ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27672024-10-01T02:34:41.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27682024-10-01T02:34:41.625ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27692024-10-01T02:34:41.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27702024-10-01T02:34:41.632ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 599.468935ms iteration = 4 status = {}
27712024-10-01T02:34:41.675ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 914 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = ce7c7a64-f5b1-4785-8c54-c7b987fdf644 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
27722024-10-01T02:34:42.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1af97d2f-89fb-45ed-8082-91ac10baff1e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27732024-10-01T02:34:42.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1af97d2f-89fb-45ed-8082-91ac10baff1e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27742024-10-01T02:34:42.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1af97d2f-89fb-45ed-8082-91ac10baff1e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27752024-10-01T02:34:43.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6839a47c-d251-4302-8b91-36334c68bff5 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27762024-10-01T02:34:43.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6839a47c-d251-4302-8b91-36334c68bff5 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27772024-10-01T02:34:43.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6839a47c-d251-4302-8b91-36334c68bff5 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27782024-10-01T02:34:44.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5d4bd5f2-b602-482e-aaf3-7c57f62f69a9 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27792024-10-01T02:34:44.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5d4bd5f2-b602-482e-aaf3-7c57f62f69a9 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27802024-10-01T02:34:44.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5d4bd5f2-b602-482e-aaf3-7c57f62f69a9 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27812024-10-01T02:34:45.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 38f23b31-a0a1-4896-97ee-a6db278effe2 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27822024-10-01T02:34:45.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 38f23b31-a0a1-4896-97ee-a6db278effe2 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27832024-10-01T02:34:45.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 38f23b31-a0a1-4896-97ee-a6db278effe2 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27842024-10-01T02:34:46.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 73c57f4a-db0c-48e1-8775-0e95ea9ff602 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27852024-10-01T02:34:46.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 73c57f4a-db0c-48e1-8775-0e95ea9ff602 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27862024-10-01T02:34:46.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2802 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 73c57f4a-db0c-48e1-8775-0e95ea9ff602 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27872024-10-01T02:34:47.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 69bbd710-1c19-436d-be89-b66df83592ae roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27882024-10-01T02:34:47.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 69bbd710-1c19-436d-be89-b66df83592ae resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27892024-10-01T02:34:47.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 69bbd710-1c19-436d-be89-b66df83592ae response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27902024-10-01T02:34:48.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a9eafc28-8358-450e-95a8-0e66ce37b3c7 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27912024-10-01T02:34:48.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a9eafc28-8358-450e-95a8-0e66ce37b3c7 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27922024-10-01T02:34:48.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a9eafc28-8358-450e-95a8-0e66ce37b3c7 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27932024-10-01T02:34:49.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6e50527d-d932-4141-a7c4-a3c6ce34a38c roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27942024-10-01T02:34:49.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6e50527d-d932-4141-a7c4-a3c6ce34a38c resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27952024-10-01T02:34:49.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6e50527d-d932-4141-a7c4-a3c6ce34a38c response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27962024-10-01T02:34:50.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ac157888-fd96-408a-a128-9323de82b4b4 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27972024-10-01T02:34:50.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ac157888-fd96-408a-a128-9323de82b4b4 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27982024-10-01T02:34:50.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1684 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ac157888-fd96-408a-a128-9323de82b4b4 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
27992024-10-01T02:34:51.032ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
28002024-10-01T02:34:51.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28012024-10-01T02:34:51.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28022024-10-01T02:34:51.032ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
28032024-10-01T02:34:51.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28042024-10-01T02:34:51.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28052024-10-01T02:34:51.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28062024-10-01T02:34:51.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28072024-10-01T02:34:51.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28082024-10-01T02:34:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28092024-10-01T02:34:51.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28102024-10-01T02:34:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28112024-10-01T02:34:51.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28122024-10-01T02:34:51.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28132024-10-01T02:34:51.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28142024-10-01T02:34:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
28152024-10-01T02:34:51.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28162024-10-01T02:34:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28172024-10-01T02:34:51.051ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
28182024-10-01T02:34:51.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.402935ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
28192024-10-01T02:34:51.067ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.514999ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28202024-10-01T02:34:51.674ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 415 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 94deaf6e-6a63-45c5-934e-9353bec8f991 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
28212024-10-01T02:34:51.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 21f45b34-aa3a-4c28-8026-c10d5877afcb roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28222024-10-01T02:34:51.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 21f45b34-aa3a-4c28-8026-c10d5877afcb resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28232024-10-01T02:34:51.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1810 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 21f45b34-aa3a-4c28-8026-c10d5877afcb response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28242024-10-01T02:34:52.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9dc149d7-3d8e-455e-b7bd-149477234f74 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28252024-10-01T02:34:52.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9dc149d7-3d8e-455e-b7bd-149477234f74 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28262024-10-01T02:34:52.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2674 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9dc149d7-3d8e-455e-b7bd-149477234f74 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28272024-10-01T02:34:53.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 165ac74d-2a08-4f29-960f-f6db2d56f0ec roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28282024-10-01T02:34:53.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 165ac74d-2a08-4f29-960f-f6db2d56f0ec resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28292024-10-01T02:34:53.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 165ac74d-2a08-4f29-960f-f6db2d56f0ec response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28302024-10-01T02:34:54.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3ebba7ae-9198-44e3-bd7d-fcb8591c60b2 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28312024-10-01T02:34:54.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3ebba7ae-9198-44e3-bd7d-fcb8591c60b2 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28322024-10-01T02:34:54.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3ebba7ae-9198-44e3-bd7d-fcb8591c60b2 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28332024-10-01T02:34:55.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ad2ac412-9be0-4c92-a117-f711305c9324 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28342024-10-01T02:34:55.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ad2ac412-9be0-4c92-a117-f711305c9324 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28352024-10-01T02:34:55.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ad2ac412-9be0-4c92-a117-f711305c9324 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28362024-10-01T02:34:56.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dc53aec0-b1ee-4914-91b9-38980778a966 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28372024-10-01T02:34:56.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dc53aec0-b1ee-4914-91b9-38980778a966 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28382024-10-01T02:34:56.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1777 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dc53aec0-b1ee-4914-91b9-38980778a966 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28392024-10-01T02:34:57.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 01edb202-242c-4687-9bee-2ab34a20450e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28402024-10-01T02:34:57.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 01edb202-242c-4687-9bee-2ab34a20450e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28412024-10-01T02:34:57.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1893 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 01edb202-242c-4687-9bee-2ab34a20450e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28422024-10-01T02:34:58.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b3ecb099-541a-4953-bdc8-1639276d1f4f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28432024-10-01T02:34:58.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b3ecb099-541a-4953-bdc8-1639276d1f4f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28442024-10-01T02:34:58.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b3ecb099-541a-4953-bdc8-1639276d1f4f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28452024-10-01T02:34:59.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 25ac7232-0247-4284-877e-59b28c4312bb roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28462024-10-01T02:34:59.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 25ac7232-0247-4284-877e-59b28c4312bb resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28472024-10-01T02:34:59.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 25ac7232-0247-4284-877e-59b28c4312bb response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28482024-10-01T02:35:00.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f42366c0-388c-4490-9004-f9a419740f61 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28492024-10-01T02:35:00.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f42366c0-388c-4490-9004-f9a419740f61 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28502024-10-01T02:35:00.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f42366c0-388c-4490-9004-f9a419740f61 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28512024-10-01T02:35:01.031ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
28522024-10-01T02:35:01.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28532024-10-01T02:35:01.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28542024-10-01T02:35:01.032ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
28552024-10-01T02:35:01.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28562024-10-01T02:35:01.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28572024-10-01T02:35:01.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28582024-10-01T02:35:01.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28592024-10-01T02:35:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28602024-10-01T02:35:01.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28612024-10-01T02:35:01.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28622024-10-01T02:35:01.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28632024-10-01T02:35:01.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28642024-10-01T02:35:01.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28652024-10-01T02:35:01.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28662024-10-01T02:35:01.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
28672024-10-01T02:35:01.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28682024-10-01T02:35:01.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28692024-10-01T02:35:01.048ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
28702024-10-01T02:35:01.048ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.379975ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
28712024-10-01T02:35:01.061ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.827203ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28722024-10-01T02:35:01.674ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 479 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 92f56991-93ec-417f-b8e1-a1581cc3fbbc response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
28732024-10-01T02:35:01.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6362176d-349d-490e-a537-7f6c2aa03335 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28742024-10-01T02:35:01.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6362176d-349d-490e-a537-7f6c2aa03335 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28752024-10-01T02:35:01.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6362176d-349d-490e-a537-7f6c2aa03335 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28762024-10-01T02:35:02.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1e38afd9-8ae7-4a28-8b6a-4b901eec7820 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28772024-10-01T02:35:02.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1e38afd9-8ae7-4a28-8b6a-4b901eec7820 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28782024-10-01T02:35:02.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1741 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1e38afd9-8ae7-4a28-8b6a-4b901eec7820 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28792024-10-01T02:35:04.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5672d4e0-f915-49f8-a65a-e965e722c709 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28802024-10-01T02:35:04.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5672d4e0-f915-49f8-a65a-e965e722c709 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28812024-10-01T02:35:04.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5672d4e0-f915-49f8-a65a-e965e722c709 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28822024-10-01T02:35:05.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 24c765eb-f618-4c93-be3b-f21cfc932367 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28832024-10-01T02:35:05.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 24c765eb-f618-4c93-be3b-f21cfc932367 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28842024-10-01T02:35:05.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 24c765eb-f618-4c93-be3b-f21cfc932367 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28852024-10-01T02:35:06.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9e124e89-a1a6-4c20-af12-a79575d90f9b roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28862024-10-01T02:35:06.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9e124e89-a1a6-4c20-af12-a79575d90f9b resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28872024-10-01T02:35:06.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9e124e89-a1a6-4c20-af12-a79575d90f9b response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28882024-10-01T02:35:07.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d81d09bb-2655-483e-abfc-f5fda40d5f46 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28892024-10-01T02:35:07.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d81d09bb-2655-483e-abfc-f5fda40d5f46 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28902024-10-01T02:35:07.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d81d09bb-2655-483e-abfc-f5fda40d5f46 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28912024-10-01T02:35:08.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 947e8714-10c9-4814-a1d6-12f6166663ae roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28922024-10-01T02:35:08.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 947e8714-10c9-4814-a1d6-12f6166663ae resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28932024-10-01T02:35:08.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 947e8714-10c9-4814-a1d6-12f6166663ae response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28942024-10-01T02:35:09.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 94376683-0721-4584-8e8a-c5ba1d8fdb20 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28952024-10-01T02:35:09.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 94376683-0721-4584-8e8a-c5ba1d8fdb20 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28962024-10-01T02:35:09.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 94376683-0721-4584-8e8a-c5ba1d8fdb20 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28972024-10-01T02:35:10.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6201dc3e-9416-4c12-8ff1-92e6f7241ec3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28982024-10-01T02:35:10.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6201dc3e-9416-4c12-8ff1-92e6f7241ec3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
28992024-10-01T02:35:10.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6201dc3e-9416-4c12-8ff1-92e6f7241ec3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
29002024-10-01T02:35:11.031ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
29012024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29022024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
29032024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
29042024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
29052024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
29062024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
29072024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
29082024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29092024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29102024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
29112024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
29122024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
29132024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
29142024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
29152024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
29162024-10-01T02:35:11.032ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07
29172024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29182024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.64\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07"}
29192024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
29202024-10-01T02:35:11.032ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-01 02:25:11.032158436 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
29212024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
29222024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
29232024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
29242024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29252024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29262024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29272024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29282024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
29292024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29302024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
29312024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29322024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
29332024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
29342024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
29352024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
29362024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
29372024-10-01T02:35:11.032ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29382024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29392024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29402024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29412024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
29422024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29432024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
29442024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29452024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
29462024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
29472024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
29482024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29492024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
29502024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
29512024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
29522024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29532024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
29542024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29552024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
29562024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29572024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
29582024-10-01T02:35:11.033ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 475618056 } })
29592024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29602024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
29612024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
29622024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
29632024-10-01T02:35:11.033ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
29642024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
29652024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
29662024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29672024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
29682024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29692024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
29702024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29712024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29722024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29732024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29742024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29752024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29762024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29772024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29782024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29792024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29802024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
29812024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29822024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
29832024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29842024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29852024-10-01T02:35:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29862024-10-01T02:35:11.034ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 477164442 } })
29872024-10-01T02:35:11.034ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
29882024-10-01T02:35:11.034ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.762636ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
29892024-10-01T02:35:11.035ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29902024-10-01T02:35:11.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29912024-10-01T02:35:11.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29922024-10-01T02:35:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29932024-10-01T02:35:11.036ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 478916241 } })
29942024-10-01T02:35:11.036ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
29952024-10-01T02:35:11.036ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.405494ms iteration = 3 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
29962024-10-01T02:35:11.037ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
29972024-10-01T02:35:11.037ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.443721ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29982024-10-01T02:35:11.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
29992024-10-01T02:35:11.037ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30002024-10-01T02:35:11.037ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-01 02:25:11.032158436 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
30012024-10-01T02:35:11.037ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.545733ms iteration = 3 status = {"expiration":"2024-10-01T02:25:11.032158436Z","pruned":[]}
30022024-10-01T02:35:11.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30032024-10-01T02:35:11.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30042024-10-01T02:35:11.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30052024-10-01T02:35:11.038ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 481200000 } })
30062024-10-01T02:35:11.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30072024-10-01T02:35:11.039ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
30082024-10-01T02:35:11.039ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30092024-10-01T02:35:11.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30102024-10-01T02:35:11.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30112024-10-01T02:35:11.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30122024-10-01T02:35:11.044ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.635955ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
30132024-10-01T02:35:11.045ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30142024-10-01T02:35:11.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30152024-10-01T02:35:11.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30162024-10-01T02:35:11.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
30172024-10-01T02:35:11.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30182024-10-01T02:35:11.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30192024-10-01T02:35:11.046ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30202024-10-01T02:35:11.046ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30212024-10-01T02:35:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30222024-10-01T02:35:11.050ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30232024-10-01T02:35:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
30242024-10-01T02:35:11.050ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30252024-10-01T02:35:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30262024-10-01T02:35:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30272024-10-01T02:35:11.052ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.241783ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
30282024-10-01T02:35:11.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30292024-10-01T02:35:11.053ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30302024-10-01T02:35:11.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
30312024-10-01T02:35:11.056ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30322024-10-01T02:35:11.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30332024-10-01T02:35:11.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
30342024-10-01T02:35:11.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30352024-10-01T02:35:11.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30362024-10-01T02:35:11.060ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30372024-10-01T02:35:11.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30382024-10-01T02:35:11.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30392024-10-01T02:35:11.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30402024-10-01T02:35:11.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30412024-10-01T02:35:11.062ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30422024-10-01T02:35:11.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30432024-10-01T02:35:11.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30442024-10-01T02:35:11.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30452024-10-01T02:35:11.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30462024-10-01T02:35:11.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30472024-10-01T02:35:11.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30482024-10-01T02:35:11.069ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30492024-10-01T02:35:11.069ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 512130908 } })
30502024-10-01T02:35:11.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30512024-10-01T02:35:11.071ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30522024-10-01T02:35:11.071ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30532024-10-01T02:35:11.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30542024-10-01T02:35:11.071ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
30552024-10-01T02:35:11.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30562024-10-01T02:35:11.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
30572024-10-01T02:35:11.075ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30582024-10-01T02:35:11.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30592024-10-01T02:35:11.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
30602024-10-01T02:35:11.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30612024-10-01T02:35:11.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30622024-10-01T02:35:11.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30632024-10-01T02:35:11.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30642024-10-01T02:35:11.088ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30652024-10-01T02:35:11.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30662024-10-01T02:35:11.096ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
30672024-10-01T02:35:11.096ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
30682024-10-01T02:35:11.096ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.273841ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
30692024-10-01T02:35:11.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.320292ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
30702024-10-01T02:35:11.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30712024-10-01T02:35:11.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30722024-10-01T02:35:11.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30732024-10-01T02:35:11.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30742024-10-01T02:35:11.107ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 74.335745ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
30752024-10-01T02:35:11.109ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30762024-10-01T02:35:11.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30772024-10-01T02:35:11.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30782024-10-01T02:35:11.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30792024-10-01T02:35:11.111ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.367933ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
30802024-10-01T02:35:11.114ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30812024-10-01T02:35:11.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30822024-10-01T02:35:11.114ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 81.929312ms iteration = 7 status = {"physical_disks_added":0}
30832024-10-01T02:35:11.116ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30842024-10-01T02:35:11.116ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30852024-10-01T02:35:11.116ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30862024-10-01T02:35:11.116ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
30872024-10-01T02:35:11.116ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30882024-10-01T02:35:11.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30892024-10-01T02:35:11.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30902024-10-01T02:35:11.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30912024-10-01T02:35:11.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30922024-10-01T02:35:11.119ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
30932024-10-01T02:35:11.119ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
30942024-10-01T02:35:11.119ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
30952024-10-01T02:35:11.119ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30962024-10-01T02:35:11.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
30972024-10-01T02:35:11.119ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30982024-10-01T02:35:11.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30992024-10-01T02:35:11.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31002024-10-01T02:35:11.123ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.771301ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31012024-10-01T02:35:11.124ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31022024-10-01T02:35:11.124ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31032024-10-01T02:35:11.125ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 92.608031ms iteration = 5 status = 0
31042024-10-01T02:35:11.126ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
31052024-10-01T02:35:11.126ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.780828ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
31062024-10-01T02:35:11.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31072024-10-01T02:35:11.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31082024-10-01T02:35:11.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31092024-10-01T02:35:11.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31102024-10-01T02:35:11.130ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
31112024-10-01T02:35:11.130ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
31122024-10-01T02:35:11.130ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
31132024-10-01T02:35:11.130ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31142024-10-01T02:35:11.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31152024-10-01T02:35:11.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31162024-10-01T02:35:11.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31172024-10-01T02:35:11.135ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31182024-10-01T02:35:11.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31192024-10-01T02:35:11.142ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
31202024-10-01T02:35:11.142ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
31212024-10-01T02:35:11.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31222024-10-01T02:35:11.142ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
31232024-10-01T02:35:11.142ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
31242024-10-01T02:35:11.142ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 109.625957ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
31252024-10-01T02:35:11.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31262024-10-01T02:35:11.145ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31272024-10-01T02:35:11.145ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31282024-10-01T02:35:11.145ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 112.675189ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
31292024-10-01T02:35:11.149ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31302024-10-01T02:35:11.149ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31312024-10-01T02:35:11.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31322024-10-01T02:35:11.154ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
31332024-10-01T02:35:11.154ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
31342024-10-01T02:35:11.154ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-01 02:33:12.369795 UTC dns_group = internal generation = 1
31352024-10-01T02:35:11.154ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 122.785988ms iteration = 3 status = {"generation":1}
31362024-10-01T02:35:11.158ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31372024-10-01T02:35:11.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31382024-10-01T02:35:11.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7ef23021-5895-4504-8ff0-fd1895d4577f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
31392024-10-01T02:35:11.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7ef23021-5895-4504-8ff0-fd1895d4577f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
31402024-10-01T02:35:11.160ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31412024-10-01T02:35:11.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7ef23021-5895-4504-8ff0-fd1895d4577f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
31422024-10-01T02:35:11.162ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31432024-10-01T02:35:11.162ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31442024-10-01T02:35:11.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31452024-10-01T02:35:11.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 139.328005ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31462024-10-01T02:35:11.175ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31472024-10-01T02:35:11.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31482024-10-01T02:35:11.179ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
31492024-10-01T02:35:11.179ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 0 version = 2
31502024-10-01T02:35:11.179ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31512024-10-01T02:35:11.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31522024-10-01T02:35:11.181ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31532024-10-01T02:35:11.181ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
31542024-10-01T02:35:11.181ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31552024-10-01T02:35:11.183ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d88df88-6c89-46e4-a50a-eb43edf14221", "content-length": "26", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
31562024-10-01T02:35:11.183ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31572024-10-01T02:35:11.185ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31582024-10-01T02:35:11.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31592024-10-01T02:35:11.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31602024-10-01T02:35:11.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31612024-10-01T02:35:11.189ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 1 version = 2
31622024-10-01T02:35:11.189ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
31632024-10-01T02:35:11.189ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-01 02:33:13.765844 UTC dns_group = external generation = 2
31642024-10-01T02:35:11.189ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 157.574571ms iteration = 3 status = {"generation":2}
31652024-10-01T02:35:11.192ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31662024-10-01T02:35:11.192ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31672024-10-01T02:35:11.192ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31682024-10-01T02:35:11.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31692024-10-01T02:35:11.194ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31702024-10-01T02:35:11.194ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
31712024-10-01T02:35:11.194ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 162.043075ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
31722024-10-01T02:35:11.208ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-01T02:33:09.142901Z, time_modified: 2024-10-01T02:33:09.142901Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
31732024-10-01T02:35:11.208ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 176.131572ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]}},"default_endpoint":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
31742024-10-01T02:35:11.212ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
31752024-10-01T02:35:11.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31762024-10-01T02:35:11.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31772024-10-01T02:35:11.276ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31782024-10-01T02:35:11.278ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31792024-10-01T02:35:11.278ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31802024-10-01T02:35:11.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31812024-10-01T02:35:11.280ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31822024-10-01T02:35:11.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31832024-10-01T02:35:11.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31842024-10-01T02:35:11.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31852024-10-01T02:35:11.292ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
31862024-10-01T02:35:11.292ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 259.065021ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
31872024-10-01T02:35:11.325ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
31882024-10-01T02:35:11.325ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31892024-10-01T02:35:11.327ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "22da0f4a-35d4-496d-ab00-61aba03f5275", "content-length": "26", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
31902024-10-01T02:35:11.327ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31912024-10-01T02:35:11.329ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31922024-10-01T02:35:11.363ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31932024-10-01T02:35:11.363ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
31942024-10-01T02:35:11.363ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "655f536e-5b59-4cf4-b2cb-6ea3704fb7d9", "content-length": "372", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
31952024-10-01T02:35:11.363ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31962024-10-01T02:35:11.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31972024-10-01T02:35:11.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31982024-10-01T02:35:11.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31992024-10-01T02:35:11.370ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32002024-10-01T02:35:11.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32012024-10-01T02:35:11.373ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32022024-10-01T02:35:11.374ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "468127c5-9178-4793-9610-7829c433bc15", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
32032024-10-01T02:35:11.375ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 342.502709ms iteration = 5 status = {}
32042024-10-01T02:35:11.381ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
32052024-10-01T02:35:11.381ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32062024-10-01T02:35:11.381ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c197e69-e4ec-4e4d-8064-5e5489701702", "content-length": "26", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
32072024-10-01T02:35:11.381ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32082024-10-01T02:35:11.383ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
32092024-10-01T02:35:11.423ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
32102024-10-01T02:35:11.423ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b6bc624a-9847-4d60-b30f-368c3d10b840", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32112024-10-01T02:35:11.423ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32122024-10-01T02:35:11.425ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f8f53ea0-b3e5-40c1-b2bc-09f0b004fb5f", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32132024-10-01T02:35:11.425ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32142024-10-01T02:35:11.427ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32152024-10-01T02:35:11.427ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 395.549188ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
32162024-10-01T02:35:11.435ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
32172024-10-01T02:35:11.436ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b446590f-e4df-4a78-b58c-e5c067fe9a1c", "content-length": "2", "date": "Tue, 01 Oct 2024 02:35:10 GMT"} })
32182024-10-01T02:35:11.438ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32192024-10-01T02:35:11.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32202024-10-01T02:35:11.440ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 408.487064ms iteration = 5 status = null
32212024-10-01T02:35:11.448ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32222024-10-01T02:35:11.449ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f53785f2-49ff-4d77-b631-f9604d71bd22", "content-length": "691", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
32232024-10-01T02:35:11.449ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
32242024-10-01T02:35:11.449ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
32252024-10-01T02:35:11.449ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
32262024-10-01T02:35:11.449ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 416.794924ms iteration = 5 status = {}
32272024-10-01T02:35:11.473ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 441.131191ms iteration = 5 status = {}
32282024-10-01T02:35:11.482ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
32292024-10-01T02:35:11.573ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
32302024-10-01T02:35:11.574ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4a9088ee-f63f-4e0e-8c0b-e4efc5cb3b0e", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32312024-10-01T02:35:11.574ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32322024-10-01T02:35:11.576ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "233d43ef-074e-4706-b03d-e535c63f3dc3", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32332024-10-01T02:35:11.576ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32342024-10-01T02:35:11.578ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "bb871cd5-9e16-40fc-968d-8f7719125b3e", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32352024-10-01T02:35:11.578ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32362024-10-01T02:35:11.580ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32372024-10-01T02:35:11.580ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 548.691154ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
32382024-10-01T02:35:11.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32392024-10-01T02:35:11.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32402024-10-01T02:35:11.598ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
32412024-10-01T02:35:11.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32422024-10-01T02:35:11.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32432024-10-01T02:35:11.621ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32442024-10-01T02:35:11.622ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9847c0d-d5ec-499a-8171-22843e852c69", "content-length": "121", "date": "Tue, 01 Oct 2024 02:35:10 GMT"} })
32452024-10-01T02:35:11.622ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
32462024-10-01T02:35:11.622ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
32472024-10-01T02:35:11.622ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32482024-10-01T02:35:11.622ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32492024-10-01T02:35:11.622ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
32502024-10-01T02:35:11.622ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
32512024-10-01T02:35:11.622ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
32522024-10-01T02:35:11.622ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32532024-10-01T02:35:11.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32542024-10-01T02:35:11.630ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32552024-10-01T02:35:11.630ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a42116d7-9abd-404d-93a4-60ccb1f01b6d", "content-length": "2", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
32562024-10-01T02:35:11.630ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32572024-10-01T02:35:11.630ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "83929caf-9822-43c6-b2da-691441dc8a99", "content-length": "52", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
32582024-10-01T02:35:11.630ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
32592024-10-01T02:35:11.630ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32602024-10-01T02:35:11.676ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1692 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 6ac17b00-c8a5-439d-9cfb-ce80a1261fcf response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
32612024-10-01T02:35:11.744ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "29c18a6f-bf87-44cb-b893-6dd609fc1cc3", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
32622024-10-01T02:35:11.744ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
32632024-10-01T02:35:11.744ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32642024-10-01T02:35:11.846ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "813614b2-c00c-4b11-9b5f-7ce589b996a8", "content-length": "667", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
32652024-10-01T02:35:11.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32662024-10-01T02:35:11.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32672024-10-01T02:35:11.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32682024-10-01T02:35:11.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32692024-10-01T02:35:11.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32702024-10-01T02:35:11.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32712024-10-01T02:35:11.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32722024-10-01T02:35:11.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32732024-10-01T02:35:11.863ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 830.270913ms iteration = 5 status = {}
32742024-10-01T02:35:12.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7e207b46-546d-4eec-b950-3f843140d99c roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32752024-10-01T02:35:12.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7e207b46-546d-4eec-b950-3f843140d99c resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32762024-10-01T02:35:12.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7e207b46-546d-4eec-b950-3f843140d99c response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32772024-10-01T02:35:13.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ab60eedb-9993-4a54-93fd-8b07be11caba roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32782024-10-01T02:35:13.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ab60eedb-9993-4a54-93fd-8b07be11caba resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32792024-10-01T02:35:13.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ab60eedb-9993-4a54-93fd-8b07be11caba response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32802024-10-01T02:35:14.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 71527cc6-a806-4610-9195-044ff6402ea5 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32812024-10-01T02:35:14.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 71527cc6-a806-4610-9195-044ff6402ea5 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32822024-10-01T02:35:14.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 71527cc6-a806-4610-9195-044ff6402ea5 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32832024-10-01T02:35:15.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 988fc912-3fb6-4ab5-912b-8e233df3839e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32842024-10-01T02:35:15.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 988fc912-3fb6-4ab5-912b-8e233df3839e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32852024-10-01T02:35:15.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 988fc912-3fb6-4ab5-912b-8e233df3839e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32862024-10-01T02:35:16.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4cb9e99c-8346-4170-920c-a603128ee72b roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32872024-10-01T02:35:16.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4cb9e99c-8346-4170-920c-a603128ee72b resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32882024-10-01T02:35:16.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1928 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4cb9e99c-8346-4170-920c-a603128ee72b response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32892024-10-01T02:35:17.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3fc40ebd-4f98-49a7-a698-f31ed663f6bc roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32902024-10-01T02:35:17.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3fc40ebd-4f98-49a7-a698-f31ed663f6bc resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32912024-10-01T02:35:17.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3fc40ebd-4f98-49a7-a698-f31ed663f6bc response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32922024-10-01T02:35:18.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3d6f0eb5-a138-4336-ab28-9a5aa4b06135 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32932024-10-01T02:35:18.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3d6f0eb5-a138-4336-ab28-9a5aa4b06135 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32942024-10-01T02:35:18.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3d6f0eb5-a138-4336-ab28-9a5aa4b06135 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32952024-10-01T02:35:19.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b68cb91d-58f2-4b6d-a263-e66f0c5142ea roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32962024-10-01T02:35:19.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b68cb91d-58f2-4b6d-a263-e66f0c5142ea resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32972024-10-01T02:35:19.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2355 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b68cb91d-58f2-4b6d-a263-e66f0c5142ea response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32982024-10-01T02:35:20.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5c157ff2-690b-4171-9954-25f331ccc78a roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
32992024-10-01T02:35:20.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5c157ff2-690b-4171-9954-25f331ccc78a resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33002024-10-01T02:35:20.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5c157ff2-690b-4171-9954-25f331ccc78a response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33012024-10-01T02:35:21.032ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
33022024-10-01T02:35:21.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33032024-10-01T02:35:21.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33042024-10-01T02:35:21.033ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
33052024-10-01T02:35:21.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33062024-10-01T02:35:21.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33072024-10-01T02:35:21.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33082024-10-01T02:35:21.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33092024-10-01T02:35:21.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33102024-10-01T02:35:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33112024-10-01T02:35:21.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33122024-10-01T02:35:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33132024-10-01T02:35:21.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33142024-10-01T02:35:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33152024-10-01T02:35:21.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33162024-10-01T02:35:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
33172024-10-01T02:35:21.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33182024-10-01T02:35:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33192024-10-01T02:35:21.050ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
33202024-10-01T02:35:21.050ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.165295ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
33212024-10-01T02:35:21.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.493718ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33222024-10-01T02:35:21.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0296fd1b-6852-4160-add8-a1659d7c7265 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33232024-10-01T02:35:21.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0296fd1b-6852-4160-add8-a1659d7c7265 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33242024-10-01T02:35:21.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0296fd1b-6852-4160-add8-a1659d7c7265 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33252024-10-01T02:35:21.674ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 389 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 2bc94c9e-b1a4-4359-95ee-206beec60ce3 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
33262024-10-01T02:35:22.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0a2fcd2e-7d06-4587-859a-7f118d489db5 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33272024-10-01T02:35:22.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0a2fcd2e-7d06-4587-859a-7f118d489db5 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33282024-10-01T02:35:22.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1808 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0a2fcd2e-7d06-4587-859a-7f118d489db5 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33292024-10-01T02:35:23.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0f6a90ec-283f-4fdb-9011-ca51e3980260 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33302024-10-01T02:35:23.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0f6a90ec-283f-4fdb-9011-ca51e3980260 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33312024-10-01T02:35:23.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0f6a90ec-283f-4fdb-9011-ca51e3980260 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33322024-10-01T02:35:24.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a5a9f71b-0277-4345-97c3-90a822ba8f88 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33332024-10-01T02:35:24.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a5a9f71b-0277-4345-97c3-90a822ba8f88 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33342024-10-01T02:35:24.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a5a9f71b-0277-4345-97c3-90a822ba8f88 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33352024-10-01T02:35:25.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4f34caeb-5de6-4b70-bbdb-6af38da60b10 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33362024-10-01T02:35:25.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4f34caeb-5de6-4b70-bbdb-6af38da60b10 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33372024-10-01T02:35:25.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4f34caeb-5de6-4b70-bbdb-6af38da60b10 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33382024-10-01T02:35:26.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6be83b39-470a-4656-869c-aed3d5d0df68 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33392024-10-01T02:35:26.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6be83b39-470a-4656-869c-aed3d5d0df68 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33402024-10-01T02:35:26.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6be83b39-470a-4656-869c-aed3d5d0df68 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33412024-10-01T02:35:27.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f8d929b0-6ffc-4f0b-9514-451e2614ad00 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33422024-10-01T02:35:27.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f8d929b0-6ffc-4f0b-9514-451e2614ad00 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33432024-10-01T02:35:27.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2755 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f8d929b0-6ffc-4f0b-9514-451e2614ad00 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33442024-10-01T02:35:28.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b22470a2-bd64-4b97-962b-84406c94587b roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33452024-10-01T02:35:28.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b22470a2-bd64-4b97-962b-84406c94587b resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33462024-10-01T02:35:28.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1767 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b22470a2-bd64-4b97-962b-84406c94587b response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33472024-10-01T02:35:29.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 85254d9d-2e3b-4921-998d-81091b525249 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33482024-10-01T02:35:29.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 85254d9d-2e3b-4921-998d-81091b525249 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33492024-10-01T02:35:29.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 85254d9d-2e3b-4921-998d-81091b525249 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33502024-10-01T02:35:30.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b12f3c04-db95-4e7c-9a7c-7d4628a6cc9f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33512024-10-01T02:35:30.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b12f3c04-db95-4e7c-9a7c-7d4628a6cc9f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33522024-10-01T02:35:30.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1871 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b12f3c04-db95-4e7c-9a7c-7d4628a6cc9f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33532024-10-01T02:35:31.032ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
33542024-10-01T02:35:31.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33552024-10-01T02:35:31.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33562024-10-01T02:35:31.032ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
33572024-10-01T02:35:31.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33582024-10-01T02:35:31.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33592024-10-01T02:35:31.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33602024-10-01T02:35:31.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33612024-10-01T02:35:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33622024-10-01T02:35:31.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33632024-10-01T02:35:31.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33642024-10-01T02:35:31.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.525046ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33652024-10-01T02:35:31.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33662024-10-01T02:35:31.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33672024-10-01T02:35:31.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33682024-10-01T02:35:31.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33692024-10-01T02:35:31.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
33702024-10-01T02:35:31.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33712024-10-01T02:35:31.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33722024-10-01T02:35:31.050ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
33732024-10-01T02:35:31.050ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.073853ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
33742024-10-01T02:35:31.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cfcf8a7a-70f6-42d5-98a8-caa7636190cd roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33752024-10-01T02:35:31.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cfcf8a7a-70f6-42d5-98a8-caa7636190cd resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33762024-10-01T02:35:31.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cfcf8a7a-70f6-42d5-98a8-caa7636190cd response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33772024-10-01T02:35:31.675ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 397 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 403a3be8-17fa-4853-a722-d3be83a38887 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
33782024-10-01T02:35:32.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 21cb2209-0a31-498a-b314-39409c7e484a roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33792024-10-01T02:35:32.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 21cb2209-0a31-498a-b314-39409c7e484a resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33802024-10-01T02:35:32.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 21cb2209-0a31-498a-b314-39409c7e484a response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33812024-10-01T02:35:33.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 48ec05a5-ef05-4d7d-97c3-e1d36e068fd9 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33822024-10-01T02:35:33.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 48ec05a5-ef05-4d7d-97c3-e1d36e068fd9 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33832024-10-01T02:35:33.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 48ec05a5-ef05-4d7d-97c3-e1d36e068fd9 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33842024-10-01T02:35:34.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c17a3d68-5fe8-4531-a375-6a30dc0bd8f8 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33852024-10-01T02:35:34.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c17a3d68-5fe8-4531-a375-6a30dc0bd8f8 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33862024-10-01T02:35:34.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c17a3d68-5fe8-4531-a375-6a30dc0bd8f8 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33872024-10-01T02:35:35.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8637febc-bb31-4e91-afea-85c02935eea8 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33882024-10-01T02:35:35.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8637febc-bb31-4e91-afea-85c02935eea8 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33892024-10-01T02:35:35.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8637febc-bb31-4e91-afea-85c02935eea8 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33902024-10-01T02:35:36.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 97ef7d31-ecf0-4cbc-a1a5-f9f0d15e1825 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33912024-10-01T02:35:36.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 97ef7d31-ecf0-4cbc-a1a5-f9f0d15e1825 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33922024-10-01T02:35:36.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 97ef7d31-ecf0-4cbc-a1a5-f9f0d15e1825 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33932024-10-01T02:35:37.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = df8a9de7-f0c4-409a-b655-23cce07ee526 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33942024-10-01T02:35:37.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = df8a9de7-f0c4-409a-b655-23cce07ee526 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33952024-10-01T02:35:37.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = df8a9de7-f0c4-409a-b655-23cce07ee526 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33962024-10-01T02:35:38.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d77c2a0c-8a8e-4631-8d0e-10d6a7350dfb roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33972024-10-01T02:35:38.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d77c2a0c-8a8e-4631-8d0e-10d6a7350dfb resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33982024-10-01T02:35:38.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d77c2a0c-8a8e-4631-8d0e-10d6a7350dfb response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
33992024-10-01T02:35:39.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9f62d75f-841c-4002-aa15-a82315c7557f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
34002024-10-01T02:35:39.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9f62d75f-841c-4002-aa15-a82315c7557f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
34012024-10-01T02:35:39.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9f62d75f-841c-4002-aa15-a82315c7557f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
34022024-10-01T02:35:40.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 54279ebb-8a54-405b-9ba0-bb295327daf1 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
34032024-10-01T02:35:40.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 54279ebb-8a54-405b-9ba0-bb295327daf1 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
34042024-10-01T02:35:40.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 54279ebb-8a54-405b-9ba0-bb295327daf1 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
34052024-10-01T02:35:41.032ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
34062024-10-01T02:35:41.032ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
34072024-10-01T02:35:41.032ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34082024-10-01T02:35:41.032ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34092024-10-01T02:35:41.032ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
34102024-10-01T02:35:41.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34112024-10-01T02:35:41.032ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
34122024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34132024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34142024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34152024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
34162024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
34172024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
34182024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
34192024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34202024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34212024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
34222024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34232024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
34242024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
34252024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
34262024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
34272024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34282024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34292024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
34302024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
34312024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34322024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34332024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
34342024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34352024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
34362024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34372024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
34382024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
34392024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34402024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
34412024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34422024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34432024-10-01T02:35:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
34442024-10-01T02:35:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
34452024-10-01T02:35:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34462024-10-01T02:35:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34472024-10-01T02:35:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34482024-10-01T02:35:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34492024-10-01T02:35:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34502024-10-01T02:35:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34512024-10-01T02:35:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34522024-10-01T02:35:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34532024-10-01T02:35:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34542024-10-01T02:35:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34552024-10-01T02:35:41.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34562024-10-01T02:35:41.036ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1394, tv_nsec: 478306632 } })
34572024-10-01T02:35:41.036ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1394, tv_nsec: 478656737 } })
34582024-10-01T02:35:41.036ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.089759ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
34592024-10-01T02:35:41.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34602024-10-01T02:35:41.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34612024-10-01T02:35:41.037ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
34622024-10-01T02:35:41.037ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
34632024-10-01T02:35:41.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34642024-10-01T02:35:41.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34652024-10-01T02:35:41.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34662024-10-01T02:35:41.039ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34672024-10-01T02:35:41.040ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34682024-10-01T02:35:41.040ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34692024-10-01T02:35:41.041ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34702024-10-01T02:35:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34712024-10-01T02:35:41.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34722024-10-01T02:35:41.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34732024-10-01T02:35:41.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34742024-10-01T02:35:41.043ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34752024-10-01T02:35:41.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34762024-10-01T02:35:41.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34772024-10-01T02:35:41.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34782024-10-01T02:35:41.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34792024-10-01T02:35:41.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34802024-10-01T02:35:41.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34812024-10-01T02:35:41.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34822024-10-01T02:35:41.044ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34832024-10-01T02:35:41.044ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34842024-10-01T02:35:41.044ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34852024-10-01T02:35:41.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34862024-10-01T02:35:41.045ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34872024-10-01T02:35:41.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34882024-10-01T02:35:41.047ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34892024-10-01T02:35:41.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34902024-10-01T02:35:41.047ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34912024-10-01T02:35:41.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34922024-10-01T02:35:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34932024-10-01T02:35:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34942024-10-01T02:35:41.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34952024-10-01T02:35:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34962024-10-01T02:35:41.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34972024-10-01T02:35:41.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34982024-10-01T02:35:41.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 16.1144ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34992024-10-01T02:35:41.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35002024-10-01T02:35:41.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35012024-10-01T02:35:41.052ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35022024-10-01T02:35:41.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35032024-10-01T02:35:41.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 19.342564ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
35042024-10-01T02:35:41.053ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35052024-10-01T02:35:41.053ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35062024-10-01T02:35:41.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35072024-10-01T02:35:41.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35082024-10-01T02:35:41.054ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1394, tv_nsec: 496697680 } })
35092024-10-01T02:35:41.054ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
35102024-10-01T02:35:41.055ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35112024-10-01T02:35:41.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35122024-10-01T02:35:41.058ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35132024-10-01T02:35:41.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35142024-10-01T02:35:41.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35152024-10-01T02:35:41.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35162024-10-01T02:35:41.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 40.273415ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
35172024-10-01T02:35:41.080ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.022499ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
35182024-10-01T02:35:41.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35192024-10-01T02:35:41.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
35202024-10-01T02:35:41.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35212024-10-01T02:35:41.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35222024-10-01T02:35:41.097ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35232024-10-01T02:35:41.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35242024-10-01T02:35:41.099ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35252024-10-01T02:35:41.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35262024-10-01T02:35:41.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35272024-10-01T02:35:41.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35282024-10-01T02:35:41.101ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 68.147322ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
35292024-10-01T02:35:41.103ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35302024-10-01T02:35:41.104ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
35312024-10-01T02:35:41.104ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 71.921975ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
35322024-10-01T02:35:41.105ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35332024-10-01T02:35:41.105ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35342024-10-01T02:35:41.105ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 71.62568ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35352024-10-01T02:35:41.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
35362024-10-01T02:35:41.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35372024-10-01T02:35:41.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35382024-10-01T02:35:41.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35392024-10-01T02:35:41.106ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35402024-10-01T02:35:41.106ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.916452ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35412024-10-01T02:35:41.108ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 74.334165ms iteration = 6 status = 0
35422024-10-01T02:35:41.108ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35432024-10-01T02:35:41.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35442024-10-01T02:35:41.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35452024-10-01T02:35:41.115ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.554317ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35462024-10-01T02:35:41.131ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
35472024-10-01T02:35:41.131ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35482024-10-01T02:35:41.131ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "79e0ce90-388e-4fff-82f8-9a119110a127", "content-length": "26", "date": "Tue, 01 Oct 2024 02:35:41 GMT"} })
35492024-10-01T02:35:41.131ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35502024-10-01T02:35:41.133ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35512024-10-01T02:35:41.143ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
35522024-10-01T02:35:41.143ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35532024-10-01T02:35:41.144ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aeb79811-b0f5-436e-b1f4-9752932bd08f", "content-length": "26", "date": "Tue, 01 Oct 2024 02:35:41 GMT"} })
35542024-10-01T02:35:41.144ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35552024-10-01T02:35:41.145ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35562024-10-01T02:35:41.155ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
35572024-10-01T02:35:41.155ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35582024-10-01T02:35:41.156ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddc41c34-c51d-4b9d-85c8-e4c046f8b83e", "content-length": "26", "date": "Tue, 01 Oct 2024 02:35:41 GMT"} })
35592024-10-01T02:35:41.156ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35602024-10-01T02:35:41.157ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
35612024-10-01T02:35:41.179ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 145.339115ms iteration = 8 status = {"physical_disks_added":0}
35622024-10-01T02:35:41.184ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35632024-10-01T02:35:41.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35642024-10-01T02:35:41.218ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35652024-10-01T02:35:41.220ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35662024-10-01T02:35:41.220ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35672024-10-01T02:35:41.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35682024-10-01T02:35:41.251ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
35692024-10-01T02:35:41.251ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6bef752-4824-4cc8-9ee4-d81d3eca45bd", "content-length": "2", "date": "Tue, 01 Oct 2024 02:35:40 GMT"} })
35702024-10-01T02:35:41.252ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35712024-10-01T02:35:41.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35722024-10-01T02:35:41.264ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 231.977198ms iteration = 6 status = {}
35732024-10-01T02:35:41.303ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35742024-10-01T02:35:41.304ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7b15730-e7ee-4a04-aac4-470b6b4bc39a", "content-length": "372", "date": "Tue, 01 Oct 2024 02:35:41 GMT"} })
35752024-10-01T02:35:41.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35762024-10-01T02:35:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35772024-10-01T02:35:41.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35782024-10-01T02:35:41.306ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 273.793578ms iteration = 6 status = null
35792024-10-01T02:35:41.306ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35802024-10-01T02:35:41.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35812024-10-01T02:35:41.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35822024-10-01T02:35:41.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35832024-10-01T02:35:41.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35842024-10-01T02:35:41.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35852024-10-01T02:35:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35862024-10-01T02:35:41.312ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35872024-10-01T02:35:41.313ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "22acbdbb-677f-4637-aa8e-436a3b66a4a9", "date": "Tue, 01 Oct 2024 02:35:41 GMT"} })
35882024-10-01T02:35:41.315ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 281.406156ms iteration = 6 status = {}
35892024-10-01T02:35:41.369ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35902024-10-01T02:35:41.374ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35912024-10-01T02:35:41.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35922024-10-01T02:35:41.377ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
35932024-10-01T02:35:41.377ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35942024-10-01T02:35:41.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35952024-10-01T02:35:41.386ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35962024-10-01T02:35:41.387ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e47db76-c917-49e8-be5b-2f3384db55c3", "content-length": "121", "date": "Tue, 01 Oct 2024 02:35:40 GMT"} })
35972024-10-01T02:35:41.387ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
35982024-10-01T02:35:41.387ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
35992024-10-01T02:35:41.387ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36002024-10-01T02:35:41.387ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36012024-10-01T02:35:41.387ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
36022024-10-01T02:35:41.387ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
36032024-10-01T02:35:41.387ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
36042024-10-01T02:35:41.387ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36052024-10-01T02:35:41.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36062024-10-01T02:35:41.389ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36072024-10-01T02:35:41.390ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4c479dc-7482-46c7-b4ae-e29b784995dc", "content-length": "2", "date": "Tue, 01 Oct 2024 02:35:40 GMT"} })
36082024-10-01T02:35:41.390ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36092024-10-01T02:35:41.390ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "282ed4c5-301b-4899-a393-f2cf7d9e2226", "content-length": "52", "date": "Tue, 01 Oct 2024 02:35:40 GMT"} })
36102024-10-01T02:35:41.390ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
36112024-10-01T02:35:41.390ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36122024-10-01T02:35:41.428ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc9b399b-6677-409c-9615-86c0de5826ca", "content-length": "691", "date": "Tue, 01 Oct 2024 02:35:41 GMT"} })
36132024-10-01T02:35:41.428ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
36142024-10-01T02:35:41.428ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
36152024-10-01T02:35:41.428ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
36162024-10-01T02:35:41.430ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 396.795728ms iteration = 6 status = {}
36172024-10-01T02:35:41.542ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1253fa35-16b2-4a45-b977-6f633dc94961", "date": "Tue, 01 Oct 2024 02:35:41 GMT"} })
36182024-10-01T02:35:41.542ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
36192024-10-01T02:35:41.542ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36202024-10-01T02:35:41.543ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "75fdf42c-9260-49a5-93ea-035cddfa6533", "content-length": "667", "date": "Tue, 01 Oct 2024 02:35:41 GMT"} })
36212024-10-01T02:35:41.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36222024-10-01T02:35:41.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36232024-10-01T02:35:41.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36242024-10-01T02:35:41.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36252024-10-01T02:35:41.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36262024-10-01T02:35:41.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36272024-10-01T02:35:41.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36282024-10-01T02:35:41.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36292024-10-01T02:35:41.559ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 525.355933ms iteration = 6 status = {}
36302024-10-01T02:35:41.674ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 467 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 40f840ab-f456-4321-bb0c-211e8e893822 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
36312024-10-01T02:35:41.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 167dc953-dd06-4883-8b13-ce8bae329d6e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36322024-10-01T02:35:41.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 167dc953-dd06-4883-8b13-ce8bae329d6e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36332024-10-01T02:35:41.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 167dc953-dd06-4883-8b13-ce8bae329d6e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36342024-10-01T02:35:42.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0a1c07ae-2022-49f7-b562-2aa62f837c53 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36352024-10-01T02:35:42.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0a1c07ae-2022-49f7-b562-2aa62f837c53 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36362024-10-01T02:35:42.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0a1c07ae-2022-49f7-b562-2aa62f837c53 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36372024-10-01T02:35:43.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e2020fc1-ba09-4607-83a9-7b2ac2c4309f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36382024-10-01T02:35:43.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e2020fc1-ba09-4607-83a9-7b2ac2c4309f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36392024-10-01T02:35:43.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e2020fc1-ba09-4607-83a9-7b2ac2c4309f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36402024-10-01T02:35:44.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fb98fb3b-2224-407f-b077-83805be6aa92 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36412024-10-01T02:35:44.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fb98fb3b-2224-407f-b077-83805be6aa92 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36422024-10-01T02:35:44.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3792 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fb98fb3b-2224-407f-b077-83805be6aa92 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36432024-10-01T02:35:45.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 17a5a526-c42e-4b89-8751-b5721b067abe roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36442024-10-01T02:35:45.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 17a5a526-c42e-4b89-8751-b5721b067abe resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36452024-10-01T02:35:45.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 17a5a526-c42e-4b89-8751-b5721b067abe response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36462024-10-01T02:35:46.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 34216035-a5f7-4e88-85c5-9bffd3b60ff4 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36472024-10-01T02:35:46.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 34216035-a5f7-4e88-85c5-9bffd3b60ff4 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36482024-10-01T02:35:46.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3736 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 34216035-a5f7-4e88-85c5-9bffd3b60ff4 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36492024-10-01T02:35:48.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 880111b6-2874-44c7-84e3-bfa34e87a439 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36502024-10-01T02:35:48.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 880111b6-2874-44c7-84e3-bfa34e87a439 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36512024-10-01T02:35:48.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 880111b6-2874-44c7-84e3-bfa34e87a439 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36522024-10-01T02:35:49.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0cade4e7-460c-487f-ac4d-80067b9d241d roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36532024-10-01T02:35:49.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0cade4e7-460c-487f-ac4d-80067b9d241d resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36542024-10-01T02:35:49.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0cade4e7-460c-487f-ac4d-80067b9d241d response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36552024-10-01T02:35:50.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9e63c32c-8ffc-46f8-a614-6e92df008043 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36562024-10-01T02:35:50.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9e63c32c-8ffc-46f8-a614-6e92df008043 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36572024-10-01T02:35:50.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9e63c32c-8ffc-46f8-a614-6e92df008043 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36582024-10-01T02:35:51.032ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
36592024-10-01T02:35:51.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36602024-10-01T02:35:51.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36612024-10-01T02:35:51.033ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
36622024-10-01T02:35:51.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36632024-10-01T02:35:51.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36642024-10-01T02:35:51.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36652024-10-01T02:35:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36662024-10-01T02:35:51.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36672024-10-01T02:35:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36682024-10-01T02:35:51.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36692024-10-01T02:35:51.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36702024-10-01T02:35:51.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36712024-10-01T02:35:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
36722024-10-01T02:35:51.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36732024-10-01T02:35:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36742024-10-01T02:35:51.049ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
36752024-10-01T02:35:51.049ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.992105ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
36762024-10-01T02:35:51.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36772024-10-01T02:35:51.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36782024-10-01T02:35:51.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6b5844e7-791e-4723-aee8-878d59e4cc5d roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36792024-10-01T02:35:51.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6b5844e7-791e-4723-aee8-878d59e4cc5d resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36802024-10-01T02:35:51.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6b5844e7-791e-4723-aee8-878d59e4cc5d response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36812024-10-01T02:35:51.095ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.540122ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36822024-10-01T02:35:51.675ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 739 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = dd16e225-12c3-4055-adb1-0df74f03a287 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
36832024-10-01T02:35:52.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e9765cd4-9ae0-4037-bbca-3436269a21a6 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36842024-10-01T02:35:52.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e9765cd4-9ae0-4037-bbca-3436269a21a6 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36852024-10-01T02:35:52.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1808 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e9765cd4-9ae0-4037-bbca-3436269a21a6 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36862024-10-01T02:35:53.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bd4ac181-bd90-4d69-aea1-442f69d21083 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36872024-10-01T02:35:53.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bd4ac181-bd90-4d69-aea1-442f69d21083 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36882024-10-01T02:35:53.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bd4ac181-bd90-4d69-aea1-442f69d21083 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36892024-10-01T02:35:54.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c0c602db-effc-42ce-af47-bc6f74f9e8c3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36902024-10-01T02:35:54.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c0c602db-effc-42ce-af47-bc6f74f9e8c3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36912024-10-01T02:35:54.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c0c602db-effc-42ce-af47-bc6f74f9e8c3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36922024-10-01T02:35:55.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a8c747db-bb4d-46bb-bd09-03ef74c99790 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36932024-10-01T02:35:55.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a8c747db-bb4d-46bb-bd09-03ef74c99790 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36942024-10-01T02:35:55.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2788 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a8c747db-bb4d-46bb-bd09-03ef74c99790 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36952024-10-01T02:35:56.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8c360010-220d-48fd-8436-226a6f1a8d05 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36962024-10-01T02:35:56.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8c360010-220d-48fd-8436-226a6f1a8d05 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36972024-10-01T02:35:56.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8c360010-220d-48fd-8436-226a6f1a8d05 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36982024-10-01T02:35:57.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2df3e023-991f-4efc-bed8-7e750d3e13a3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
36992024-10-01T02:35:57.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2df3e023-991f-4efc-bed8-7e750d3e13a3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37002024-10-01T02:35:57.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1864 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2df3e023-991f-4efc-bed8-7e750d3e13a3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37012024-10-01T02:35:58.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a9d66c0d-ee1d-42ae-8918-992174af5f92 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37022024-10-01T02:35:58.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a9d66c0d-ee1d-42ae-8918-992174af5f92 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37032024-10-01T02:35:58.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a9d66c0d-ee1d-42ae-8918-992174af5f92 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37042024-10-01T02:35:59.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 74cfb87b-e659-4ffa-b250-6faba040e0ad roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37052024-10-01T02:35:59.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 74cfb87b-e659-4ffa-b250-6faba040e0ad resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37062024-10-01T02:35:59.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 74cfb87b-e659-4ffa-b250-6faba040e0ad response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37072024-10-01T02:36:00.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b0b41d67-3bbb-4286-8676-0bf1c2ec5006 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37082024-10-01T02:36:00.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b0b41d67-3bbb-4286-8676-0bf1c2ec5006 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37092024-10-01T02:36:00.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b0b41d67-3bbb-4286-8676-0bf1c2ec5006 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37102024-10-01T02:36:01.032ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
37112024-10-01T02:36:01.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37122024-10-01T02:36:01.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37132024-10-01T02:36:01.033ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
37142024-10-01T02:36:01.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37152024-10-01T02:36:01.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37162024-10-01T02:36:01.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37172024-10-01T02:36:01.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37182024-10-01T02:36:01.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37192024-10-01T02:36:01.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37202024-10-01T02:36:01.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37212024-10-01T02:36:01.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37222024-10-01T02:36:01.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.748573ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37232024-10-01T02:36:01.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37242024-10-01T02:36:01.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37252024-10-01T02:36:01.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37262024-10-01T02:36:01.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
37272024-10-01T02:36:01.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37282024-10-01T02:36:01.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37292024-10-01T02:36:01.051ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
37302024-10-01T02:36:01.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.370258ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
37312024-10-01T02:36:01.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 127ce458-273d-4849-9590-b6b690360304 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37322024-10-01T02:36:01.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 127ce458-273d-4849-9590-b6b690360304 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37332024-10-01T02:36:01.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 127ce458-273d-4849-9590-b6b690360304 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37342024-10-01T02:36:01.675ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 619 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 08207149-e957-4bc1-bc1e-5649c710b1c5 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
37352024-10-01T02:36:02.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a61e2a9c-d95e-4c3e-abf4-1c99f2e7b3c3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37362024-10-01T02:36:02.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a61e2a9c-d95e-4c3e-abf4-1c99f2e7b3c3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37372024-10-01T02:36:02.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1800 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a61e2a9c-d95e-4c3e-abf4-1c99f2e7b3c3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37382024-10-01T02:36:03.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 88aba138-152c-461e-b3bf-7a80bf3ce6c4 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37392024-10-01T02:36:03.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 88aba138-152c-461e-b3bf-7a80bf3ce6c4 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37402024-10-01T02:36:03.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1837 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 88aba138-152c-461e-b3bf-7a80bf3ce6c4 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37412024-10-01T02:36:04.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0e74231f-feb3-4907-b690-6d8d679192ca roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37422024-10-01T02:36:04.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0e74231f-feb3-4907-b690-6d8d679192ca resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37432024-10-01T02:36:04.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0e74231f-feb3-4907-b690-6d8d679192ca response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37442024-10-01T02:36:05.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6e26a796-c1ea-42f9-8221-003b9c915ec6 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37452024-10-01T02:36:05.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6e26a796-c1ea-42f9-8221-003b9c915ec6 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37462024-10-01T02:36:05.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6e26a796-c1ea-42f9-8221-003b9c915ec6 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37472024-10-01T02:36:06.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f17629c3-8455-42b1-b34e-fee3f99fd43e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37482024-10-01T02:36:06.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f17629c3-8455-42b1-b34e-fee3f99fd43e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37492024-10-01T02:36:06.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f17629c3-8455-42b1-b34e-fee3f99fd43e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37502024-10-01T02:36:07.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 37f76513-7c15-4e94-8d0f-60faa889f901 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37512024-10-01T02:36:07.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 37f76513-7c15-4e94-8d0f-60faa889f901 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37522024-10-01T02:36:07.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 37f76513-7c15-4e94-8d0f-60faa889f901 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37532024-10-01T02:36:08.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cb5b56fc-ae07-4758-81fc-c81556535ed2 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37542024-10-01T02:36:08.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cb5b56fc-ae07-4758-81fc-c81556535ed2 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37552024-10-01T02:36:08.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cb5b56fc-ae07-4758-81fc-c81556535ed2 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37562024-10-01T02:36:09.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = da06cb9d-620f-4fc4-8d6a-272166ccd5d6 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37572024-10-01T02:36:09.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = da06cb9d-620f-4fc4-8d6a-272166ccd5d6 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37582024-10-01T02:36:09.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = da06cb9d-620f-4fc4-8d6a-272166ccd5d6 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37592024-10-01T02:36:10.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 98ad8bab-b00a-400d-a898-1b68c002e4ea roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37602024-10-01T02:36:10.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 98ad8bab-b00a-400d-a898-1b68c002e4ea resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37612024-10-01T02:36:10.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 98ad8bab-b00a-400d-a898-1b68c002e4ea response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
37622024-10-01T02:36:11.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
37632024-10-01T02:36:11.032ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
37642024-10-01T02:36:11.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37652024-10-01T02:36:11.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
37662024-10-01T02:36:11.032ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
37672024-10-01T02:36:11.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
37682024-10-01T02:36:11.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37692024-10-01T02:36:11.032ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
37702024-10-01T02:36:11.032ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37712024-10-01T02:36:11.032ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
37722024-10-01T02:36:11.032ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37732024-10-01T02:36:11.032ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
37742024-10-01T02:36:11.032ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
37752024-10-01T02:36:11.032ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
37762024-10-01T02:36:11.032ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-01 02:26:11.032863976 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
37772024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
37782024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
37792024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
37802024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
37812024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
37822024-10-01T02:36:11.033ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07
37832024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37842024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.391\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07"}
37852024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
37862024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
37872024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37882024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37892024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37902024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37912024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
37922024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37932024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
37942024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
37952024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
37962024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37972024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
37982024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
37992024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
38002024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38012024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
38022024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38032024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
38042024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
38052024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38062024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
38072024-10-01T02:36:11.033ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
38082024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38092024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
38102024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38112024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
38122024-10-01T02:36:11.033ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 475404023 } })
38132024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
38142024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38152024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
38162024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38172024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
38182024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38192024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
38202024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
38212024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38222024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
38232024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38242024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38252024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
38262024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
38272024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38282024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38292024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
38302024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38312024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
38322024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38332024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38342024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
38352024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38362024-10-01T02:36:11.033ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38372024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
38382024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38392024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38402024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38412024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38422024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38432024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38442024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
38452024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38462024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38472024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38482024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38492024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38502024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38512024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38522024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38532024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38542024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38552024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38562024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38572024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38582024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38592024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38602024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38612024-10-01T02:36:11.034ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 476511281 } })
38622024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38632024-10-01T02:36:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38642024-10-01T02:36:11.036ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38652024-10-01T02:36:11.036ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
38662024-10-01T02:36:11.036ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.617741ms iteration = 4 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
38672024-10-01T02:36:11.036ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
38682024-10-01T02:36:11.036ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.647511ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
38692024-10-01T02:36:11.037ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.540926ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
38702024-10-01T02:36:11.037ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 479281248 } })
38712024-10-01T02:36:11.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
38722024-10-01T02:36:11.037ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
38732024-10-01T02:36:11.037ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38742024-10-01T02:36:11.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38752024-10-01T02:36:11.037ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 479710905 } })
38762024-10-01T02:36:11.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38772024-10-01T02:36:11.038ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-01 02:26:11.032863976 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
38782024-10-01T02:36:11.038ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.702705ms iteration = 4 status = {"expiration":"2024-10-01T02:26:11.032863976Z","pruned":[]}
38792024-10-01T02:36:11.038ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
38802024-10-01T02:36:11.040ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.56156ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
38812024-10-01T02:36:11.040ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38822024-10-01T02:36:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38832024-10-01T02:36:11.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38842024-10-01T02:36:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38852024-10-01T02:36:11.041ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
38862024-10-01T02:36:11.041ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
38872024-10-01T02:36:11.041ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 7.475146ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
38882024-10-01T02:36:11.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38892024-10-01T02:36:11.042ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38902024-10-01T02:36:11.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38912024-10-01T02:36:11.043ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38922024-10-01T02:36:11.044ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38932024-10-01T02:36:11.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
38942024-10-01T02:36:11.046ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38952024-10-01T02:36:11.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38962024-10-01T02:36:11.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
38972024-10-01T02:36:11.046ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38982024-10-01T02:36:11.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38992024-10-01T02:36:11.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39002024-10-01T02:36:11.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39012024-10-01T02:36:11.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39022024-10-01T02:36:11.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39032024-10-01T02:36:11.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39042024-10-01T02:36:11.054ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39052024-10-01T02:36:11.054ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39062024-10-01T02:36:11.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39072024-10-01T02:36:11.057ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39082024-10-01T02:36:11.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39092024-10-01T02:36:11.057ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39102024-10-01T02:36:11.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39112024-10-01T02:36:11.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39122024-10-01T02:36:11.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39132024-10-01T02:36:11.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39142024-10-01T02:36:11.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39152024-10-01T02:36:11.060ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39162024-10-01T02:36:11.061ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39172024-10-01T02:36:11.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39182024-10-01T02:36:11.063ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39192024-10-01T02:36:11.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39202024-10-01T02:36:11.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39212024-10-01T02:36:11.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39222024-10-01T02:36:11.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39232024-10-01T02:36:11.069ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39242024-10-01T02:36:11.069ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39252024-10-01T02:36:11.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39262024-10-01T02:36:11.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39272024-10-01T02:36:11.072ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39282024-10-01T02:36:11.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39292024-10-01T02:36:11.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39302024-10-01T02:36:11.081ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39312024-10-01T02:36:11.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39322024-10-01T02:36:11.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39332024-10-01T02:36:11.083ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39342024-10-01T02:36:11.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39352024-10-01T02:36:11.084ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39362024-10-01T02:36:11.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39372024-10-01T02:36:11.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39382024-10-01T02:36:11.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39392024-10-01T02:36:11.086ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39402024-10-01T02:36:11.088ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39412024-10-01T02:36:11.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39422024-10-01T02:36:11.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
39432024-10-01T02:36:11.091ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39442024-10-01T02:36:11.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39452024-10-01T02:36:11.098ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39462024-10-01T02:36:11.100ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.366372ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
39472024-10-01T02:36:11.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39482024-10-01T02:36:11.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39492024-10-01T02:36:11.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39502024-10-01T02:36:11.103ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39512024-10-01T02:36:11.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39522024-10-01T02:36:11.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39532024-10-01T02:36:11.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39542024-10-01T02:36:11.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39552024-10-01T02:36:11.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39562024-10-01T02:36:11.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39572024-10-01T02:36:11.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39582024-10-01T02:36:11.117ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39592024-10-01T02:36:11.118ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39602024-10-01T02:36:11.118ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39612024-10-01T02:36:11.118ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39622024-10-01T02:36:11.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39632024-10-01T02:36:11.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39642024-10-01T02:36:11.123ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39652024-10-01T02:36:11.123ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 89.471549ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
39662024-10-01T02:36:11.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39672024-10-01T02:36:11.125ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 566802014 } })
39682024-10-01T02:36:11.125ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
39692024-10-01T02:36:11.128ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
39702024-10-01T02:36:11.128ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
39712024-10-01T02:36:11.128ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
39722024-10-01T02:36:11.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39732024-10-01T02:36:11.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39742024-10-01T02:36:11.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39752024-10-01T02:36:11.131ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39762024-10-01T02:36:11.133ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39772024-10-01T02:36:11.133ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39782024-10-01T02:36:11.133ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39792024-10-01T02:36:11.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39802024-10-01T02:36:11.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39812024-10-01T02:36:11.134ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39822024-10-01T02:36:11.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39832024-10-01T02:36:11.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39842024-10-01T02:36:11.135ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39852024-10-01T02:36:11.135ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
39862024-10-01T02:36:11.135ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
39872024-10-01T02:36:11.135ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 101.51017ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
39882024-10-01T02:36:11.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39892024-10-01T02:36:11.137ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 103.779599ms iteration = 3 status = {"nsuccess":5}
39902024-10-01T02:36:11.145ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39912024-10-01T02:36:11.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39922024-10-01T02:36:11.148ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39932024-10-01T02:36:11.148ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 114.512899ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39942024-10-01T02:36:11.149ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39952024-10-01T02:36:11.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39962024-10-01T02:36:11.152ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39972024-10-01T02:36:11.152ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39982024-10-01T02:36:11.155ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
39992024-10-01T02:36:11.155ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40002024-10-01T02:36:11.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40012024-10-01T02:36:11.155ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 122.264688ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40022024-10-01T02:36:11.156ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
40032024-10-01T02:36:11.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40042024-10-01T02:36:11.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40052024-10-01T02:36:11.157ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 123.965347ms iteration = 7 status = 0
40062024-10-01T02:36:11.164ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40072024-10-01T02:36:11.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40082024-10-01T02:36:11.165ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
40092024-10-01T02:36:11.165ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
40102024-10-01T02:36:11.165ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
40112024-10-01T02:36:11.165ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40122024-10-01T02:36:11.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40132024-10-01T02:36:11.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 136.437316ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40142024-10-01T02:36:11.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 136.698571ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40152024-10-01T02:36:11.170ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
40162024-10-01T02:36:11.170ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 137.776449ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
40172024-10-01T02:36:11.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40182024-10-01T02:36:11.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 140.172489ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
40192024-10-01T02:36:11.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40202024-10-01T02:36:11.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40212024-10-01T02:36:11.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40222024-10-01T02:36:11.177ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
40232024-10-01T02:36:11.177ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
40242024-10-01T02:36:11.177ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40252024-10-01T02:36:11.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40262024-10-01T02:36:11.180ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
40272024-10-01T02:36:11.180ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40282024-10-01T02:36:11.181ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "11a9fcdc-db34-46fd-bd6b-46a29c1b5bf5", "content-length": "26", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
40292024-10-01T02:36:11.181ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40302024-10-01T02:36:11.181ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
40312024-10-01T02:36:11.182ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40322024-10-01T02:36:11.185ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40332024-10-01T02:36:11.185ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40342024-10-01T02:36:11.185ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 151.890285ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40352024-10-01T02:36:11.210ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
40362024-10-01T02:36:11.210ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 0 version = 2
40372024-10-01T02:36:11.210ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40382024-10-01T02:36:11.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40392024-10-01T02:36:11.212ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40402024-10-01T02:36:11.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40412024-10-01T02:36:11.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40422024-10-01T02:36:11.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40432024-10-01T02:36:11.218ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40442024-10-01T02:36:11.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40452024-10-01T02:36:11.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40462024-10-01T02:36:11.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40472024-10-01T02:36:11.224ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40482024-10-01T02:36:11.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40492024-10-01T02:36:11.227ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
40502024-10-01T02:36:11.227ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
40512024-10-01T02:36:11.227ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-01 02:33:12.369795 UTC dns_group = internal generation = 1
40522024-10-01T02:36:11.227ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 194.903266ms iteration = 4 status = {"generation":1}
40532024-10-01T02:36:11.239ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 205.849799ms iteration = 9 status = {"physical_disks_added":0}
40542024-10-01T02:36:11.271ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
40552024-10-01T02:36:11.271ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 237.903036ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
40562024-10-01T02:36:11.295ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40572024-10-01T02:36:11.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40582024-10-01T02:36:11.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40592024-10-01T02:36:11.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40602024-10-01T02:36:11.329ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 1 version = 2
40612024-10-01T02:36:11.329ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
40622024-10-01T02:36:11.329ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-01 02:33:13.765844 UTC dns_group = external generation = 2
40632024-10-01T02:36:11.329ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 296.327486ms iteration = 4 status = {"generation":2}
40642024-10-01T02:36:11.336ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40652024-10-01T02:36:11.336ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb5e1817-7ba8-403c-af90-6ae01a625e2c", "content-length": "2", "date": "Tue, 01 Oct 2024 02:36:10 GMT"} })
40662024-10-01T02:36:11.337ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40672024-10-01T02:36:11.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40682024-10-01T02:36:11.361ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
40692024-10-01T02:36:11.361ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40702024-10-01T02:36:11.362ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "47dbb201-b0c7-4e7c-906e-5ddfc029ae3b", "content-length": "26", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
40712024-10-01T02:36:11.362ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40722024-10-01T02:36:11.363ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40732024-10-01T02:36:11.365ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
40742024-10-01T02:36:11.366ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
40752024-10-01T02:36:11.367ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40762024-10-01T02:36:11.368ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9beafba6-5fc3-47fd-9fc5-e33e290a5859", "content-length": "372", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
40772024-10-01T02:36:11.368ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40782024-10-01T02:36:11.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40792024-10-01T02:36:11.370ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40802024-10-01T02:36:11.371ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 338.251007ms iteration = 7 status = null
40812024-10-01T02:36:11.371ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40822024-10-01T02:36:11.371ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40832024-10-01T02:36:11.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40842024-10-01T02:36:11.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40852024-10-01T02:36:11.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40862024-10-01T02:36:11.373ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40872024-10-01T02:36:11.374ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40882024-10-01T02:36:11.374ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40892024-10-01T02:36:11.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40902024-10-01T02:36:11.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40912024-10-01T02:36:11.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40922024-10-01T02:36:11.377ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40932024-10-01T02:36:11.377ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "13d07aa4-f58f-44ca-9a09-654fbed601d6", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
40942024-10-01T02:36:11.379ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 345.416508ms iteration = 7 status = {}
40952024-10-01T02:36:11.398ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40962024-10-01T02:36:11.399ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40972024-10-01T02:36:11.399ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40982024-10-01T02:36:11.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40992024-10-01T02:36:11.449ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-01T02:33:09.142901Z, time_modified: 2024-10-01T02:33:09.142901Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }) }
41002024-10-01T02:36:11.449ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 416.187334ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]}},"default_endpoint":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
41012024-10-01T02:36:11.483ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
41022024-10-01T02:36:11.483ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41032024-10-01T02:36:11.483ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0db4670d-ff26-4265-834e-079fac2dd129", "content-length": "26", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
41042024-10-01T02:36:11.483ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41052024-10-01T02:36:11.485ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
41062024-10-01T02:36:11.493ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 460.551517ms iteration = 7 status = {}
41072024-10-01T02:36:11.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f0185e2a-262f-472d-9285-c93bef3c7cb8 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41082024-10-01T02:36:11.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f0185e2a-262f-472d-9285-c93bef3c7cb8 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41092024-10-01T02:36:11.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f0185e2a-262f-472d-9285-c93bef3c7cb8 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41102024-10-01T02:36:11.537ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41112024-10-01T02:36:11.537ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "953120e7-465d-4119-887a-6b587b925897", "content-length": "691", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
41122024-10-01T02:36:11.537ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
41132024-10-01T02:36:11.537ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
41142024-10-01T02:36:11.537ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
41152024-10-01T02:36:11.543ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 509.285313ms iteration = 7 status = {}
41162024-10-01T02:36:11.559ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41172024-10-01T02:36:11.560ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7675b8c2-2224-4651-abb3-c250f13a9611", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41182024-10-01T02:36:11.560ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41192024-10-01T02:36:11.561ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b8f90179-09c7-4c29-a4b3-506fa5fd1b0c", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41202024-10-01T02:36:11.561ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41212024-10-01T02:36:11.563ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41222024-10-01T02:36:11.563ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 530.635812ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41232024-10-01T02:36:11.566ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
41242024-10-01T02:36:11.569ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4929607e-bed3-48bd-a509-2b219fae3e59", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41252024-10-01T02:36:11.569ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41262024-10-01T02:36:11.571ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a52008a0-9950-4299-aadf-63408fa3a4c1", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41272024-10-01T02:36:11.571ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41282024-10-01T02:36:11.573ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "84be2f88-6849-4554-b47b-df39d05ea733", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41292024-10-01T02:36:11.573ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41302024-10-01T02:36:11.575ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41312024-10-01T02:36:11.575ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 542.723514ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
41322024-10-01T02:36:11.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41332024-10-01T02:36:11.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41342024-10-01T02:36:11.654ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
41352024-10-01T02:36:11.654ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41362024-10-01T02:36:11.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41372024-10-01T02:36:11.668ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41382024-10-01T02:36:11.668ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "77d5ae84-d1cb-447a-a7bb-457a4be68a2f", "content-length": "121", "date": "Tue, 01 Oct 2024 02:36:10 GMT"} })
41392024-10-01T02:36:11.668ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
41402024-10-01T02:36:11.668ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
41412024-10-01T02:36:11.669ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41422024-10-01T02:36:11.669ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41432024-10-01T02:36:11.669ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
41442024-10-01T02:36:11.669ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
41452024-10-01T02:36:11.669ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
41462024-10-01T02:36:11.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41472024-10-01T02:36:11.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41482024-10-01T02:36:11.671ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41492024-10-01T02:36:11.671ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3793ee5c-70b0-4ab3-939b-a965c9e4c69f", "content-length": "2", "date": "Tue, 01 Oct 2024 02:36:10 GMT"} })
41502024-10-01T02:36:11.671ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41512024-10-01T02:36:11.672ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e00dbe51-7130-4533-b056-c48b06cb6977", "content-length": "52", "date": "Tue, 01 Oct 2024 02:36:10 GMT"} })
41522024-10-01T02:36:11.672ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
41532024-10-01T02:36:11.672ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41542024-10-01T02:36:11.675ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 340 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 446d27b8-9ee7-49f6-a6b8-7b6ca17cc5fb response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
41552024-10-01T02:36:11.795ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f626f4e6-ba5f-46fe-a782-44479f114f94", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
41562024-10-01T02:36:11.795ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
41572024-10-01T02:36:11.795ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41582024-10-01T02:36:11.796ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa184cf4-50ba-409c-86c4-86f872d4406d", "content-length": "667", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
41592024-10-01T02:36:11.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41602024-10-01T02:36:11.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41612024-10-01T02:36:11.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41622024-10-01T02:36:11.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41632024-10-01T02:36:11.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41642024-10-01T02:36:11.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41652024-10-01T02:36:11.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41662024-10-01T02:36:11.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41672024-10-01T02:36:11.813ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 780.161343ms iteration = 7 status = {}
41682024-10-01T02:36:12.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = de5d1b0b-49ea-4688-90c3-22b864c7dfff roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41692024-10-01T02:36:12.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = de5d1b0b-49ea-4688-90c3-22b864c7dfff resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41702024-10-01T02:36:12.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = de5d1b0b-49ea-4688-90c3-22b864c7dfff response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41712024-10-01T02:36:13.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ad562e57-a322-4012-b1c7-75e3bd37202e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41722024-10-01T02:36:13.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ad562e57-a322-4012-b1c7-75e3bd37202e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41732024-10-01T02:36:13.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ad562e57-a322-4012-b1c7-75e3bd37202e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41742024-10-01T02:36:14.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f790483e-a6a5-4beb-ba14-6d6d080feaf9 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41752024-10-01T02:36:14.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f790483e-a6a5-4beb-ba14-6d6d080feaf9 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41762024-10-01T02:36:14.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f790483e-a6a5-4beb-ba14-6d6d080feaf9 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41772024-10-01T02:36:15.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2c32546e-f71d-4123-92a0-d9c102f7c84a roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41782024-10-01T02:36:15.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2c32546e-f71d-4123-92a0-d9c102f7c84a resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41792024-10-01T02:36:15.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2c32546e-f71d-4123-92a0-d9c102f7c84a response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41802024-10-01T02:36:16.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5c2aba05-a051-4dd2-acae-e53d3b74eacd roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41812024-10-01T02:36:16.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5c2aba05-a051-4dd2-acae-e53d3b74eacd resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41822024-10-01T02:36:16.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5c2aba05-a051-4dd2-acae-e53d3b74eacd response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41832024-10-01T02:36:17.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 21015387-e5b0-445c-9d2e-b2a9ff904b37 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41842024-10-01T02:36:17.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 21015387-e5b0-445c-9d2e-b2a9ff904b37 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41852024-10-01T02:36:17.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 21015387-e5b0-445c-9d2e-b2a9ff904b37 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41862024-10-01T02:36:18.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = acda5676-b243-4e92-bd1c-3851732a2085 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41872024-10-01T02:36:18.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = acda5676-b243-4e92-bd1c-3851732a2085 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41882024-10-01T02:36:18.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = acda5676-b243-4e92-bd1c-3851732a2085 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41892024-10-01T02:36:19.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cd462402-0630-4e5c-8886-9f4f3706ffde roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41902024-10-01T02:36:19.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cd462402-0630-4e5c-8886-9f4f3706ffde resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41912024-10-01T02:36:19.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cd462402-0630-4e5c-8886-9f4f3706ffde response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41922024-10-01T02:36:20.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 130560f2-b950-466a-ac33-f672b93fbeeb roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41932024-10-01T02:36:20.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 130560f2-b950-466a-ac33-f672b93fbeeb resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41942024-10-01T02:36:20.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 130560f2-b950-466a-ac33-f672b93fbeeb response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
41952024-10-01T02:36:21.032ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
41962024-10-01T02:36:21.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41972024-10-01T02:36:21.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41982024-10-01T02:36:21.033ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
41992024-10-01T02:36:21.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42002024-10-01T02:36:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42012024-10-01T02:36:21.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42022024-10-01T02:36:21.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42032024-10-01T02:36:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42042024-10-01T02:36:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42052024-10-01T02:36:21.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42062024-10-01T02:36:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42072024-10-01T02:36:21.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.007437ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42082024-10-01T02:36:21.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42092024-10-01T02:36:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42102024-10-01T02:36:21.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42112024-10-01T02:36:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
42122024-10-01T02:36:21.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42132024-10-01T02:36:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42142024-10-01T02:36:21.052ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
42152024-10-01T02:36:21.052ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.406846ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
42162024-10-01T02:36:21.675ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 505 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = f15e0912-f961-45aa-b9fc-3869f91e90ee response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
42172024-10-01T02:36:21.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 780a54a8-772e-4d6c-93f7-53342148341b roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42182024-10-01T02:36:21.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 780a54a8-772e-4d6c-93f7-53342148341b resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42192024-10-01T02:36:21.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 780a54a8-772e-4d6c-93f7-53342148341b response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42202024-10-01T02:36:22.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3826b7c4-e334-491c-8145-1c72214a1591 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42212024-10-01T02:36:22.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3826b7c4-e334-491c-8145-1c72214a1591 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42222024-10-01T02:36:22.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1902 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3826b7c4-e334-491c-8145-1c72214a1591 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42232024-10-01T02:36:23.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b248f0c7-cef1-457a-93c7-88d021dcda8e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42242024-10-01T02:36:23.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b248f0c7-cef1-457a-93c7-88d021dcda8e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42252024-10-01T02:36:23.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2679 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b248f0c7-cef1-457a-93c7-88d021dcda8e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42262024-10-01T02:36:24.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ad9b2b1a-797b-4b95-8039-8f5606075b4c roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42272024-10-01T02:36:24.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ad9b2b1a-797b-4b95-8039-8f5606075b4c resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42282024-10-01T02:36:24.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1915 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ad9b2b1a-797b-4b95-8039-8f5606075b4c response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42292024-10-01T02:36:25.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 45228df1-a919-4ab0-b32f-f4362c91623e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42302024-10-01T02:36:25.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 45228df1-a919-4ab0-b32f-f4362c91623e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42312024-10-01T02:36:25.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 45228df1-a919-4ab0-b32f-f4362c91623e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42322024-10-01T02:36:26.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f6e16686-0442-4891-a751-0bc030f45698 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42332024-10-01T02:36:26.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f6e16686-0442-4891-a751-0bc030f45698 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42342024-10-01T02:36:26.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f6e16686-0442-4891-a751-0bc030f45698 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42352024-10-01T02:36:27.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9e6996b2-7417-4c58-b6ad-5cf929ec43cf roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42362024-10-01T02:36:27.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9e6996b2-7417-4c58-b6ad-5cf929ec43cf resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42372024-10-01T02:36:27.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9e6996b2-7417-4c58-b6ad-5cf929ec43cf response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42382024-10-01T02:36:28.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 824e57ee-6d10-45eb-9479-c4a11ad296bc roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42392024-10-01T02:36:28.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 824e57ee-6d10-45eb-9479-c4a11ad296bc resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42402024-10-01T02:36:28.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 824e57ee-6d10-45eb-9479-c4a11ad296bc response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42412024-10-01T02:36:29.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 610a50cb-39f5-4afe-adab-db57ddcc6c5e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42422024-10-01T02:36:29.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 610a50cb-39f5-4afe-adab-db57ddcc6c5e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42432024-10-01T02:36:29.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 610a50cb-39f5-4afe-adab-db57ddcc6c5e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42442024-10-01T02:36:30.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1109eb58-daca-4407-b562-32e1a9f2a797 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42452024-10-01T02:36:30.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1109eb58-daca-4407-b562-32e1a9f2a797 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42462024-10-01T02:36:30.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1109eb58-daca-4407-b562-32e1a9f2a797 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42472024-10-01T02:36:31.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
42482024-10-01T02:36:31.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42492024-10-01T02:36:31.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42502024-10-01T02:36:31.033ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
42512024-10-01T02:36:31.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42522024-10-01T02:36:31.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42532024-10-01T02:36:31.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42542024-10-01T02:36:31.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42552024-10-01T02:36:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42562024-10-01T02:36:31.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.749783ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42572024-10-01T02:36:31.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42582024-10-01T02:36:31.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42592024-10-01T02:36:31.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42602024-10-01T02:36:31.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42612024-10-01T02:36:31.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42622024-10-01T02:36:31.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42632024-10-01T02:36:31.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
42642024-10-01T02:36:31.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42652024-10-01T02:36:31.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42662024-10-01T02:36:31.051ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
42672024-10-01T02:36:31.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.132764ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
42682024-10-01T02:36:31.676ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 427 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 324c3d64-b78d-4c8b-86bb-ed838e409cc7 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
42692024-10-01T02:36:31.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dcd524f7-2731-4e87-a359-c2152e3947d3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42702024-10-01T02:36:31.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dcd524f7-2731-4e87-a359-c2152e3947d3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42712024-10-01T02:36:31.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dcd524f7-2731-4e87-a359-c2152e3947d3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42722024-10-01T02:36:32.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 22bc2856-dcb2-46fb-a38a-dd09680e3186 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42732024-10-01T02:36:32.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 22bc2856-dcb2-46fb-a38a-dd09680e3186 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42742024-10-01T02:36:32.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 22bc2856-dcb2-46fb-a38a-dd09680e3186 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42752024-10-01T02:36:34.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d65c0657-bfd0-4420-8b98-a2e9ebeda434 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42762024-10-01T02:36:34.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d65c0657-bfd0-4420-8b98-a2e9ebeda434 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42772024-10-01T02:36:34.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d65c0657-bfd0-4420-8b98-a2e9ebeda434 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42782024-10-01T02:36:35.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f7194df0-fabd-4ec1-8aee-ff21826f4b5f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42792024-10-01T02:36:35.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f7194df0-fabd-4ec1-8aee-ff21826f4b5f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42802024-10-01T02:36:35.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1742 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f7194df0-fabd-4ec1-8aee-ff21826f4b5f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42812024-10-01T02:36:36.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e116f400-644e-4332-a344-c6038beb67e1 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42822024-10-01T02:36:36.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e116f400-644e-4332-a344-c6038beb67e1 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42832024-10-01T02:36:36.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2795 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e116f400-644e-4332-a344-c6038beb67e1 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42842024-10-01T02:36:37.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bb810735-c685-4fe8-9caf-4f81be36e818 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42852024-10-01T02:36:37.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bb810735-c685-4fe8-9caf-4f81be36e818 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42862024-10-01T02:36:37.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1927 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bb810735-c685-4fe8-9caf-4f81be36e818 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42872024-10-01T02:36:38.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2fd0c5d7-1734-4363-a21d-57e023e691d4 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42882024-10-01T02:36:38.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2fd0c5d7-1734-4363-a21d-57e023e691d4 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42892024-10-01T02:36:38.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2fd0c5d7-1734-4363-a21d-57e023e691d4 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42902024-10-01T02:36:39.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2a72d35b-e2b0-4048-bbfc-7c2f19881ca8 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42912024-10-01T02:36:39.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2a72d35b-e2b0-4048-bbfc-7c2f19881ca8 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42922024-10-01T02:36:39.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2a72d35b-e2b0-4048-bbfc-7c2f19881ca8 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42932024-10-01T02:36:40.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d6cad87a-30c8-4583-b717-d0cbd0b73f51 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42942024-10-01T02:36:40.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d6cad87a-30c8-4583-b717-d0cbd0b73f51 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42952024-10-01T02:36:40.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1773 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d6cad87a-30c8-4583-b717-d0cbd0b73f51 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
42962024-10-01T02:36:41.033ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
42972024-10-01T02:36:41.033ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42982024-10-01T02:36:41.033ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
42992024-10-01T02:36:41.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
43002024-10-01T02:36:41.033ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43012024-10-01T02:36:41.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43022024-10-01T02:36:41.033ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
43032024-10-01T02:36:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43042024-10-01T02:36:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43052024-10-01T02:36:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43062024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
43072024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
43082024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
43092024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
43102024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
43112024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43122024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
43132024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43142024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
43152024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43162024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
43172024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43182024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
43192024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43202024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
43212024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43222024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
43232024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43242024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43252024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
43262024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
43272024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43282024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
43292024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43302024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43312024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
43322024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43332024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43342024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
43352024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43362024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43372024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43382024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43392024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43402024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43412024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43422024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43432024-10-01T02:36:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43442024-10-01T02:36:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43452024-10-01T02:36:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43462024-10-01T02:36:41.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43472024-10-01T02:36:41.036ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1454, tv_nsec: 478233030 } })
43482024-10-01T02:36:41.037ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
43492024-10-01T02:36:41.037ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.16979ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43502024-10-01T02:36:41.037ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1454, tv_nsec: 479087655 } })
43512024-10-01T02:36:41.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.379307ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
43522024-10-01T02:36:41.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43532024-10-01T02:36:41.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43542024-10-01T02:36:41.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43552024-10-01T02:36:41.038ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
43562024-10-01T02:36:41.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43572024-10-01T02:36:41.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43582024-10-01T02:36:41.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43592024-10-01T02:36:41.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43602024-10-01T02:36:41.044ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43612024-10-01T02:36:41.045ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43622024-10-01T02:36:41.045ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43632024-10-01T02:36:41.045ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43642024-10-01T02:36:41.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43652024-10-01T02:36:41.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43662024-10-01T02:36:41.046ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43672024-10-01T02:36:41.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43682024-10-01T02:36:41.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43692024-10-01T02:36:41.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43702024-10-01T02:36:41.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43712024-10-01T02:36:41.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43722024-10-01T02:36:41.047ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43732024-10-01T02:36:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43742024-10-01T02:36:41.053ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1454, tv_nsec: 494903540 } })
43752024-10-01T02:36:41.053ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
43762024-10-01T02:36:41.055ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43772024-10-01T02:36:41.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43782024-10-01T02:36:41.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43792024-10-01T02:36:41.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43802024-10-01T02:36:41.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43812024-10-01T02:36:41.058ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43822024-10-01T02:36:41.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43832024-10-01T02:36:41.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
43842024-10-01T02:36:41.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43852024-10-01T02:36:41.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43862024-10-01T02:36:41.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43872024-10-01T02:36:41.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43882024-10-01T02:36:41.071ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
43892024-10-01T02:36:41.071ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.524726ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
43902024-10-01T02:36:41.084ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.376204ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
43912024-10-01T02:36:41.087ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43922024-10-01T02:36:41.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43932024-10-01T02:36:41.089ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43942024-10-01T02:36:41.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43952024-10-01T02:36:41.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43962024-10-01T02:36:41.094ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43972024-10-01T02:36:41.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43982024-10-01T02:36:41.095ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43992024-10-01T02:36:41.095ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44002024-10-01T02:36:41.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44012024-10-01T02:36:41.096ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44022024-10-01T02:36:41.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44032024-10-01T02:36:41.098ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44042024-10-01T02:36:41.099ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44052024-10-01T02:36:41.099ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 65.364245ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
44062024-10-01T02:36:41.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44072024-10-01T02:36:41.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44082024-10-01T02:36:41.100ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44092024-10-01T02:36:41.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44102024-10-01T02:36:41.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.264874ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44112024-10-01T02:36:41.103ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44122024-10-01T02:36:41.103ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44132024-10-01T02:36:41.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44142024-10-01T02:36:41.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44152024-10-01T02:36:41.105ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44162024-10-01T02:36:41.105ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44172024-10-01T02:36:41.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44182024-10-01T02:36:41.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44192024-10-01T02:36:41.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44202024-10-01T02:36:41.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44212024-10-01T02:36:41.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44222024-10-01T02:36:41.108ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44232024-10-01T02:36:41.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44242024-10-01T02:36:41.110ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44252024-10-01T02:36:41.110ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 74.229904ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44262024-10-01T02:36:41.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
44272024-10-01T02:36:41.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44282024-10-01T02:36:41.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44292024-10-01T02:36:41.114ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 80.443959ms iteration = 8 status = 0
44302024-10-01T02:36:41.137ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 103.206339ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
44312024-10-01T02:36:41.138ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 104.124095ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44322024-10-01T02:36:41.140ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
44332024-10-01T02:36:41.140ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44342024-10-01T02:36:41.141ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "71cd8d52-68e9-4936-af71-0e263b784f47", "content-length": "26", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
44352024-10-01T02:36:41.142ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44362024-10-01T02:36:41.143ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44372024-10-01T02:36:41.149ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44382024-10-01T02:36:41.149ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44392024-10-01T02:36:41.150ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 115.476996ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44402024-10-01T02:36:41.156ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
44412024-10-01T02:36:41.156ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44422024-10-01T02:36:41.156ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "831e8604-6150-4494-9679-bdb3deaa29b3", "content-length": "26", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
44432024-10-01T02:36:41.156ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44442024-10-01T02:36:41.157ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
44452024-10-01T02:36:41.157ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44462024-10-01T02:36:41.157ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7dad259e-ba4d-4fa1-8190-a6ba07a3a9fd", "content-length": "26", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
44472024-10-01T02:36:41.157ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44482024-10-01T02:36:41.160ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
44492024-10-01T02:36:41.160ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44502024-10-01T02:36:41.164ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 129.698293ms iteration = 10 status = {"physical_disks_added":0}
44512024-10-01T02:36:41.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3eba9d56-7d28-4df7-96fd-a92bca7bcf62 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
44522024-10-01T02:36:41.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3eba9d56-7d28-4df7-96fd-a92bca7bcf62 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
44532024-10-01T02:36:41.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3eba9d56-7d28-4df7-96fd-a92bca7bcf62 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
44542024-10-01T02:36:41.188ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44552024-10-01T02:36:41.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44562024-10-01T02:36:41.199ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44572024-10-01T02:36:41.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44582024-10-01T02:36:41.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44592024-10-01T02:36:41.203ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44602024-10-01T02:36:41.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44612024-10-01T02:36:41.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44622024-10-01T02:36:41.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44632024-10-01T02:36:41.207ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44642024-10-01T02:36:41.207ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44652024-10-01T02:36:41.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44662024-10-01T02:36:41.256ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
44672024-10-01T02:36:41.257ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "268441c5-0eea-446f-8fd2-000ec2712285", "content-length": "2", "date": "Tue, 01 Oct 2024 02:36:40 GMT"} })
44682024-10-01T02:36:41.258ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44692024-10-01T02:36:41.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44702024-10-01T02:36:41.260ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 227.36626ms iteration = 8 status = null
44712024-10-01T02:36:41.285ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44722024-10-01T02:36:41.286ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "457e29f8-d14b-4788-a9b5-06faf2c5000a", "content-length": "372", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
44732024-10-01T02:36:41.286ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44742024-10-01T02:36:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44752024-10-01T02:36:41.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44762024-10-01T02:36:41.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44772024-10-01T02:36:41.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44782024-10-01T02:36:41.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44792024-10-01T02:36:41.296ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 263.050798ms iteration = 8 status = {}
44802024-10-01T02:36:41.311ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44812024-10-01T02:36:41.311ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecee5f94-f99e-4b85-b4ee-9c2c6ede361e", "content-length": "691", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
44822024-10-01T02:36:41.311ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
44832024-10-01T02:36:41.311ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
44842024-10-01T02:36:41.311ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
44852024-10-01T02:36:41.313ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 278.960625ms iteration = 8 status = {}
44862024-10-01T02:36:41.315ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44872024-10-01T02:36:41.315ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8b6f4528-accb-4f75-a73f-964f117a27ca", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
44882024-10-01T02:36:41.317ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 282.620446ms iteration = 8 status = {}
44892024-10-01T02:36:41.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44902024-10-01T02:36:41.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44912024-10-01T02:36:41.405ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
44922024-10-01T02:36:41.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44932024-10-01T02:36:41.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44942024-10-01T02:36:41.419ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44952024-10-01T02:36:41.419ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "55f9d5c6-4e3c-4fc9-a25d-8b7cc38797c0", "content-length": "121", "date": "Tue, 01 Oct 2024 02:36:40 GMT"} })
44962024-10-01T02:36:41.419ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
44972024-10-01T02:36:41.419ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
44982024-10-01T02:36:41.420ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44992024-10-01T02:36:41.420ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45002024-10-01T02:36:41.420ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
45012024-10-01T02:36:41.420ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
45022024-10-01T02:36:41.420ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
45032024-10-01T02:36:41.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45042024-10-01T02:36:41.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45052024-10-01T02:36:41.423ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45062024-10-01T02:36:41.423ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8aa4215-fab5-4286-be1a-b18f0a435405", "content-length": "2", "date": "Tue, 01 Oct 2024 02:36:40 GMT"} })
45072024-10-01T02:36:41.423ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45082024-10-01T02:36:41.423ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "50364cde-9d04-41e9-94a9-526bb432eabf", "content-length": "52", "date": "Tue, 01 Oct 2024 02:36:40 GMT"} })
45092024-10-01T02:36:41.423ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
45102024-10-01T02:36:41.423ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45112024-10-01T02:36:41.561ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "915e0578-e48e-45ca-b039-291fbd1d79f5", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
45122024-10-01T02:36:41.561ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
45132024-10-01T02:36:41.561ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45142024-10-01T02:36:41.561ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "31629ace-4db2-4ac7-a34b-98ec2a9e3d0a", "content-length": "667", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
45152024-10-01T02:36:41.561ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45162024-10-01T02:36:41.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45172024-10-01T02:36:41.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45182024-10-01T02:36:41.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45192024-10-01T02:36:41.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45202024-10-01T02:36:41.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45212024-10-01T02:36:41.584ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45222024-10-01T02:36:41.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45232024-10-01T02:36:41.593ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 559.488535ms iteration = 8 status = {}
45242024-10-01T02:36:41.647ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
45252024-10-01T02:36:41.647ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
45262024-10-01T02:36:41.682ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
45272024-10-01T02:36:41.682ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:60796
45282024-10-01T02:36:41.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60796 req_id = 47f902c0-a292-40ed-8897-1daba680dfdb roles = RoleSet { roles: {} } uri = /metrics/producers
45292024-10-01T02:36:41.683ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 421 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 8f6c0d97-9341-41b3-bb46-300ef214cb5b response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
45302024-10-01T02:36:41.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60796 req_id = 47f902c0-a292-40ed-8897-1daba680dfdb resource = Database result = Ok(()) uri = /metrics/producers
45312024-10-01T02:36:41.721ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
45322024-10-01T02:36:41.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60796 req_id = 47f902c0-a292-40ed-8897-1daba680dfdb roles = RoleSet { roles: {} } uri = /metrics/producers
45332024-10-01T02:36:41.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60796 req_id = 47f902c0-a292-40ed-8897-1daba680dfdb resource = Database result = Ok(()) uri = /metrics/producers
45342024-10-01T02:36:41.766ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
45352024-10-01T02:36:41.766ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "e592d6d3-55e6-4040-8d53-861b2fbbea6a", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
45362024-10-01T02:36:41.766ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
45372024-10-01T02:36:41.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86403 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60796 req_id = 47f902c0-a292-40ed-8897-1daba680dfdb response_code = 201 uri = /metrics/producers
45382024-10-01T02:36:41.769ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "47f902c0-a292-40ed-8897-1daba680dfdb", "content-length": "41", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
45392024-10-01T02:36:41.771ZDEBGnexus (producer-registration-task): registered with nexus successfully
45402024-10-01T02:36:41.771ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
45412024-10-01T02:36:42.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 44a52779-5d27-47d8-bd1b-92f2c7d92b50 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45422024-10-01T02:36:42.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 44a52779-5d27-47d8-bd1b-92f2c7d92b50 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45432024-10-01T02:36:42.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2695 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 44a52779-5d27-47d8-bd1b-92f2c7d92b50 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45442024-10-01T02:36:43.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6a17e28a-81a9-4f06-9307-36e9e4bddd26 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45452024-10-01T02:36:43.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6a17e28a-81a9-4f06-9307-36e9e4bddd26 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45462024-10-01T02:36:43.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2647 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6a17e28a-81a9-4f06-9307-36e9e4bddd26 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45472024-10-01T02:36:44.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8e49d253-5f70-4e34-ba70-5c7b35b99901 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45482024-10-01T02:36:44.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8e49d253-5f70-4e34-ba70-5c7b35b99901 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45492024-10-01T02:36:44.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8e49d253-5f70-4e34-ba70-5c7b35b99901 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45502024-10-01T02:36:45.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 47e13237-b4b2-4a39-b643-3d3c5f6dd71d roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45512024-10-01T02:36:45.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 47e13237-b4b2-4a39-b643-3d3c5f6dd71d resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45522024-10-01T02:36:45.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 47e13237-b4b2-4a39-b643-3d3c5f6dd71d response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45532024-10-01T02:36:46.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 19ef0ce1-9002-4230-8694-62e494d86801 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45542024-10-01T02:36:46.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 19ef0ce1-9002-4230-8694-62e494d86801 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45552024-10-01T02:36:46.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2574 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 19ef0ce1-9002-4230-8694-62e494d86801 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45562024-10-01T02:36:47.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 23739784-7d48-43e8-9b6f-cb121c01de84 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45572024-10-01T02:36:47.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 23739784-7d48-43e8-9b6f-cb121c01de84 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45582024-10-01T02:36:47.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 23739784-7d48-43e8-9b6f-cb121c01de84 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45592024-10-01T02:36:48.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ea9f702d-09d2-4e27-866d-91be08aa925f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45602024-10-01T02:36:48.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ea9f702d-09d2-4e27-866d-91be08aa925f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45612024-10-01T02:36:48.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ea9f702d-09d2-4e27-866d-91be08aa925f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45622024-10-01T02:36:49.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 56701713-31b9-4a3b-808f-423ded9aa0b0 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45632024-10-01T02:36:49.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 56701713-31b9-4a3b-808f-423ded9aa0b0 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45642024-10-01T02:36:49.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 56701713-31b9-4a3b-808f-423ded9aa0b0 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45652024-10-01T02:36:50.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1693f993-4e3f-4e37-ae9f-d50333bb1408 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45662024-10-01T02:36:50.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1693f993-4e3f-4e37-ae9f-d50333bb1408 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45672024-10-01T02:36:50.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1693f993-4e3f-4e37-ae9f-d50333bb1408 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45682024-10-01T02:36:51.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
45692024-10-01T02:36:51.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45702024-10-01T02:36:51.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45712024-10-01T02:36:51.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
45722024-10-01T02:36:51.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45732024-10-01T02:36:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45742024-10-01T02:36:51.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45752024-10-01T02:36:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45762024-10-01T02:36:51.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45772024-10-01T02:36:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45782024-10-01T02:36:51.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45792024-10-01T02:36:51.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45802024-10-01T02:36:51.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45812024-10-01T02:36:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
45822024-10-01T02:36:51.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45832024-10-01T02:36:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45842024-10-01T02:36:51.051ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
45852024-10-01T02:36:51.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.720004ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
45862024-10-01T02:36:51.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45872024-10-01T02:36:51.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45882024-10-01T02:36:51.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.656592ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45892024-10-01T02:36:51.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 77ea6d69-88d6-46c6-861c-dbb526e54a43 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45902024-10-01T02:36:51.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 77ea6d69-88d6-46c6-861c-dbb526e54a43 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45912024-10-01T02:36:51.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 77ea6d69-88d6-46c6-861c-dbb526e54a43 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45922024-10-01T02:36:51.767ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 439 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = fd9722e4-5dfc-43ab-988e-d1f4d78cb34e response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
45932024-10-01T02:36:52.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9bb5e059-8ae4-4372-873b-07651893b208 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45942024-10-01T02:36:52.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9bb5e059-8ae4-4372-873b-07651893b208 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45952024-10-01T02:36:52.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9bb5e059-8ae4-4372-873b-07651893b208 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45962024-10-01T02:36:53.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a5337593-7d0a-4223-8251-86483434646f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45972024-10-01T02:36:53.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a5337593-7d0a-4223-8251-86483434646f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45982024-10-01T02:36:53.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a5337593-7d0a-4223-8251-86483434646f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
45992024-10-01T02:36:54.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ceee8010-3444-46f6-b836-de522166591f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46002024-10-01T02:36:54.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ceee8010-3444-46f6-b836-de522166591f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46012024-10-01T02:36:54.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ceee8010-3444-46f6-b836-de522166591f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46022024-10-01T02:36:55.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e5aaee3a-f73d-4792-bdbf-cc3a37241f09 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46032024-10-01T02:36:55.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e5aaee3a-f73d-4792-bdbf-cc3a37241f09 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46042024-10-01T02:36:55.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2364 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e5aaee3a-f73d-4792-bdbf-cc3a37241f09 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46052024-10-01T02:36:56.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2aed81ab-fa9e-4449-b657-aa87d64206c5 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46062024-10-01T02:36:56.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2aed81ab-fa9e-4449-b657-aa87d64206c5 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46072024-10-01T02:36:56.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2aed81ab-fa9e-4449-b657-aa87d64206c5 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46082024-10-01T02:36:57.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 546943cc-960a-4381-905e-da5ecee80664 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46092024-10-01T02:36:57.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 546943cc-960a-4381-905e-da5ecee80664 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46102024-10-01T02:36:57.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 546943cc-960a-4381-905e-da5ecee80664 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46112024-10-01T02:36:58.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a35ca0a4-995d-4e1f-ac93-fb787ffdd0a7 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46122024-10-01T02:36:58.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a35ca0a4-995d-4e1f-ac93-fb787ffdd0a7 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46132024-10-01T02:36:58.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a35ca0a4-995d-4e1f-ac93-fb787ffdd0a7 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46142024-10-01T02:36:59.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4c83cef9-3e9c-464a-ab64-1ea64270a0e6 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46152024-10-01T02:36:59.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4c83cef9-3e9c-464a-ab64-1ea64270a0e6 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46162024-10-01T02:36:59.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4c83cef9-3e9c-464a-ab64-1ea64270a0e6 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46172024-10-01T02:37:00.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = eb4cd3f1-1f6a-4903-80d1-ff88335d851f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46182024-10-01T02:37:00.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = eb4cd3f1-1f6a-4903-80d1-ff88335d851f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46192024-10-01T02:37:00.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = eb4cd3f1-1f6a-4903-80d1-ff88335d851f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46202024-10-01T02:37:01.032ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
46212024-10-01T02:37:01.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46222024-10-01T02:37:01.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46232024-10-01T02:37:01.033ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
46242024-10-01T02:37:01.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46252024-10-01T02:37:01.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46262024-10-01T02:37:01.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46272024-10-01T02:37:01.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46282024-10-01T02:37:01.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46292024-10-01T02:37:01.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46302024-10-01T02:37:01.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46312024-10-01T02:37:01.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46322024-10-01T02:37:01.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46332024-10-01T02:37:01.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46342024-10-01T02:37:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46352024-10-01T02:37:01.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
46362024-10-01T02:37:01.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46372024-10-01T02:37:01.068ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.772133ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46382024-10-01T02:37:01.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46392024-10-01T02:37:01.076ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
46402024-10-01T02:37:01.076ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.144663ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
46412024-10-01T02:37:01.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a06e6908-3876-4ea2-b0ad-7bc066a81fac roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46422024-10-01T02:37:01.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a06e6908-3876-4ea2-b0ad-7bc066a81fac resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46432024-10-01T02:37:01.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a06e6908-3876-4ea2-b0ad-7bc066a81fac response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46442024-10-01T02:37:01.768ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 679 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 17d670db-c753-4fcd-bfb0-5d0f776b07a6 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
46452024-10-01T02:37:02.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c8d9d616-d0f7-4b46-8572-35a2807bf4b5 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46462024-10-01T02:37:02.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c8d9d616-d0f7-4b46-8572-35a2807bf4b5 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46472024-10-01T02:37:02.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2806 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c8d9d616-d0f7-4b46-8572-35a2807bf4b5 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46482024-10-01T02:37:03.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9cb16937-55d3-47cc-bc9c-b1448d1079a7 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46492024-10-01T02:37:03.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9cb16937-55d3-47cc-bc9c-b1448d1079a7 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46502024-10-01T02:37:03.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9cb16937-55d3-47cc-bc9c-b1448d1079a7 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46512024-10-01T02:37:04.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 14cb55d6-3ed5-4ae2-9d98-1f9896ab3fcb roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46522024-10-01T02:37:04.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 14cb55d6-3ed5-4ae2-9d98-1f9896ab3fcb resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46532024-10-01T02:37:04.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1723 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 14cb55d6-3ed5-4ae2-9d98-1f9896ab3fcb response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46542024-10-01T02:37:05.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5cf304c0-362c-4341-b5a0-ca7d417ace06 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46552024-10-01T02:37:05.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5cf304c0-362c-4341-b5a0-ca7d417ace06 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46562024-10-01T02:37:05.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5cf304c0-362c-4341-b5a0-ca7d417ace06 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46572024-10-01T02:37:06.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 00852e4d-76cc-4bd5-8078-11dbfe50f028 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46582024-10-01T02:37:06.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 00852e4d-76cc-4bd5-8078-11dbfe50f028 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46592024-10-01T02:37:06.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 00852e4d-76cc-4bd5-8078-11dbfe50f028 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46602024-10-01T02:37:07.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 08a5ebe5-0dc2-40c7-bfd7-81862061dcf2 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46612024-10-01T02:37:07.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 08a5ebe5-0dc2-40c7-bfd7-81862061dcf2 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46622024-10-01T02:37:07.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1896 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 08a5ebe5-0dc2-40c7-bfd7-81862061dcf2 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46632024-10-01T02:37:08.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5818fe26-5205-4010-98d1-753223144b70 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46642024-10-01T02:37:08.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5818fe26-5205-4010-98d1-753223144b70 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46652024-10-01T02:37:08.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5818fe26-5205-4010-98d1-753223144b70 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46662024-10-01T02:37:09.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8be668f1-6b19-4e86-93ca-9cfc6f9bf230 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46672024-10-01T02:37:09.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8be668f1-6b19-4e86-93ca-9cfc6f9bf230 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46682024-10-01T02:37:09.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8be668f1-6b19-4e86-93ca-9cfc6f9bf230 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46692024-10-01T02:37:10.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9e097709-53a9-4626-ba1d-5a3ea1d01547 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46702024-10-01T02:37:10.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9e097709-53a9-4626-ba1d-5a3ea1d01547 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46712024-10-01T02:37:10.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1903 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9e097709-53a9-4626-ba1d-5a3ea1d01547 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
46722024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
46732024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46742024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
46752024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
46762024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46772024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
46782024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
46792024-10-01T02:37:11.033ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07
46802024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
46812024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46822024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46832024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.63\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07"}
46842024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
46852024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
46862024-10-01T02:37:11.033ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-01 02:27:11.033311405 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
46872024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
46882024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
46892024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
46902024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
46912024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46922024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
46932024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
46942024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
46952024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
46962024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46972024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46982024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46992024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47002024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47012024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
47022024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47032024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47042024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
47052024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
47062024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47072024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
47082024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
47092024-10-01T02:37:11.033ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
47102024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47112024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
47122024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47132024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
47142024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47152024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
47162024-10-01T02:37:11.034ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
47172024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
47182024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
47192024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
47202024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47212024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
47222024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47232024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
47242024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
47252024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
47262024-10-01T02:37:11.034ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 475299071 } })
47272024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
47282024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
47292024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47302024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47312024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
47322024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
47332024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
47342024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47352024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
47362024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
47372024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47382024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
47392024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
47402024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47412024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
47422024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47432024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47442024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47452024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
47462024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47472024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
47482024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47492024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47502024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47512024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47522024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47532024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
47542024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
47552024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
47562024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47572024-10-01T02:37:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47582024-10-01T02:37:11.035ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 476339738 } })
47592024-10-01T02:37:11.036ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
47602024-10-01T02:37:11.036ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
47612024-10-01T02:37:11.036ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.804857ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
47622024-10-01T02:37:11.036ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.853138ms iteration = 5 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
47632024-10-01T02:37:11.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47642024-10-01T02:37:11.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47652024-10-01T02:37:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47662024-10-01T02:37:11.036ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47672024-10-01T02:37:11.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47682024-10-01T02:37:11.037ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 478428873 } })
47692024-10-01T02:37:11.037ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.970277ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
47702024-10-01T02:37:11.037ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 478559675 } })
47712024-10-01T02:37:11.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47722024-10-01T02:37:11.038ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-01 02:27:11.033311405 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
47732024-10-01T02:37:11.038ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.916133ms iteration = 5 status = {"expiration":"2024-10-01T02:27:11.033311405Z","pruned":[]}
47742024-10-01T02:37:11.038ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
47752024-10-01T02:37:11.038ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
47762024-10-01T02:37:11.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47772024-10-01T02:37:11.039ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47782024-10-01T02:37:11.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47792024-10-01T02:37:11.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47802024-10-01T02:37:11.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47812024-10-01T02:37:11.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47822024-10-01T02:37:11.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47832024-10-01T02:37:11.044ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47842024-10-01T02:37:11.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47852024-10-01T02:37:11.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47862024-10-01T02:37:11.044ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47872024-10-01T02:37:11.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
47882024-10-01T02:37:11.046ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
47892024-10-01T02:37:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
47902024-10-01T02:37:11.049ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47912024-10-01T02:37:11.050ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.879586ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
47922024-10-01T02:37:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47932024-10-01T02:37:11.052ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47942024-10-01T02:37:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47952024-10-01T02:37:11.063ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47962024-10-01T02:37:11.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47972024-10-01T02:37:11.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47982024-10-01T02:37:11.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47992024-10-01T02:37:11.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48002024-10-01T02:37:11.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
48012024-10-01T02:37:11.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48022024-10-01T02:37:11.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48032024-10-01T02:37:11.095ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48042024-10-01T02:37:11.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
48052024-10-01T02:37:11.098ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48062024-10-01T02:37:11.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48072024-10-01T02:37:11.100ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.21239ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
48082024-10-01T02:37:11.100ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48092024-10-01T02:37:11.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48102024-10-01T02:37:11.100ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48112024-10-01T02:37:11.100ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
48122024-10-01T02:37:11.100ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
48132024-10-01T02:37:11.100ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 66.814249ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
48142024-10-01T02:37:11.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48152024-10-01T02:37:11.102ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48162024-10-01T02:37:11.102ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
48172024-10-01T02:37:11.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48182024-10-01T02:37:11.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48192024-10-01T02:37:11.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
48202024-10-01T02:37:11.105ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48212024-10-01T02:37:11.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48222024-10-01T02:37:11.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
48232024-10-01T02:37:11.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48242024-10-01T02:37:11.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48252024-10-01T02:37:11.106ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 547453040 } })
48262024-10-01T02:37:11.106ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
48272024-10-01T02:37:11.108ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48282024-10-01T02:37:11.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
48292024-10-01T02:37:11.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48302024-10-01T02:37:11.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48312024-10-01T02:37:11.114ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48322024-10-01T02:37:11.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48332024-10-01T02:37:11.117ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48342024-10-01T02:37:11.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48352024-10-01T02:37:11.117ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48362024-10-01T02:37:11.117ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
48372024-10-01T02:37:11.117ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48382024-10-01T02:37:11.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48392024-10-01T02:37:11.122ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48402024-10-01T02:37:11.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48412024-10-01T02:37:11.125ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48422024-10-01T02:37:11.126ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48432024-10-01T02:37:11.126ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 91.878089ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
48442024-10-01T02:37:11.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48452024-10-01T02:37:11.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48462024-10-01T02:37:11.126ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
48472024-10-01T02:37:11.126ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
48482024-10-01T02:37:11.126ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 92.635822ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
48492024-10-01T02:37:11.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48502024-10-01T02:37:11.128ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48512024-10-01T02:37:11.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48522024-10-01T02:37:11.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48532024-10-01T02:37:11.131ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 96.879194ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
48542024-10-01T02:37:11.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48552024-10-01T02:37:11.134ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
48562024-10-01T02:37:11.134ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.952192ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
48572024-10-01T02:37:11.134ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48582024-10-01T02:37:11.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48592024-10-01T02:37:11.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48602024-10-01T02:37:11.154ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48612024-10-01T02:37:11.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48622024-10-01T02:37:11.156ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48632024-10-01T02:37:11.158ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
48642024-10-01T02:37:11.158ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48652024-10-01T02:37:11.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48662024-10-01T02:37:11.162ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48672024-10-01T02:37:11.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48682024-10-01T02:37:11.164ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
48692024-10-01T02:37:11.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
48702024-10-01T02:37:11.164ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
48712024-10-01T02:37:11.164ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 130.857402ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
48722024-10-01T02:37:11.165ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48732024-10-01T02:37:11.166ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
48742024-10-01T02:37:11.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48752024-10-01T02:37:11.167ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48762024-10-01T02:37:11.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48772024-10-01T02:37:11.168ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48782024-10-01T02:37:11.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48792024-10-01T02:37:11.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48802024-10-01T02:37:11.171ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48812024-10-01T02:37:11.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48822024-10-01T02:37:11.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
48832024-10-01T02:37:11.172ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48842024-10-01T02:37:11.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48852024-10-01T02:37:11.175ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 141.930509ms iteration = 9 status = 0
48862024-10-01T02:37:11.181ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48872024-10-01T02:37:11.181ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
48882024-10-01T02:37:11.181ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 147.822767ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
48892024-10-01T02:37:11.182ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 147.855497ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48902024-10-01T02:37:11.183ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
48912024-10-01T02:37:11.188ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
48922024-10-01T02:37:11.188ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
48932024-10-01T02:37:11.188ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
48942024-10-01T02:37:11.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48952024-10-01T02:37:11.188ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
48962024-10-01T02:37:11.188ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
48972024-10-01T02:37:11.188ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
48982024-10-01T02:37:11.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48992024-10-01T02:37:11.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49002024-10-01T02:37:11.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49012024-10-01T02:37:11.191ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49022024-10-01T02:37:11.193ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 159.072106ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49032024-10-01T02:37:11.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49042024-10-01T02:37:11.194ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49052024-10-01T02:37:11.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49062024-10-01T02:37:11.196ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
49072024-10-01T02:37:11.196ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
49082024-10-01T02:37:11.196ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49092024-10-01T02:37:11.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49102024-10-01T02:37:11.198ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49112024-10-01T02:37:11.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49122024-10-01T02:37:11.200ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49132024-10-01T02:37:11.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49142024-10-01T02:37:11.202ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
49152024-10-01T02:37:11.202ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49162024-10-01T02:37:11.202ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5eb84218-693c-4cc9-baf1-895c28f7de32", "content-length": "26", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
49172024-10-01T02:37:11.202ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49182024-10-01T02:37:11.204ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49192024-10-01T02:37:11.205ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-01T02:33:09.142901Z, time_modified: 2024-10-01T02:33:09.142901Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }) }
49202024-10-01T02:37:11.205ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 172.156775ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]}},"default_endpoint":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
49212024-10-01T02:37:11.208ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
49222024-10-01T02:37:11.208ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
49232024-10-01T02:37:11.208ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
49242024-10-01T02:37:11.208ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49252024-10-01T02:37:11.208ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-01 02:33:12.369795 UTC dns_group = internal generation = 1
49262024-10-01T02:37:11.208ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 174.705257ms iteration = 5 status = {"generation":1}
49272024-10-01T02:37:11.208ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ea85f82-58dc-4f1b-8e3a-2d4132c75f8f", "content-length": "26", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
49282024-10-01T02:37:11.208ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49292024-10-01T02:37:11.210ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49302024-10-01T02:37:11.211ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 177.533975ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
49312024-10-01T02:37:11.212ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49322024-10-01T02:37:11.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49332024-10-01T02:37:11.218ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49342024-10-01T02:37:11.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49352024-10-01T02:37:11.221ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49362024-10-01T02:37:11.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49372024-10-01T02:37:11.223ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
49382024-10-01T02:37:11.223ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 0 version = 2
49392024-10-01T02:37:11.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49402024-10-01T02:37:11.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49412024-10-01T02:37:11.225ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49422024-10-01T02:37:11.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49432024-10-01T02:37:11.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49442024-10-01T02:37:11.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49452024-10-01T02:37:11.229ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 1 version = 2
49462024-10-01T02:37:11.229ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
49472024-10-01T02:37:11.229ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-01 02:33:13.765844 UTC dns_group = external generation = 2
49482024-10-01T02:37:11.229ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 196.044815ms iteration = 5 status = {"generation":2}
49492024-10-01T02:37:11.233ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
49502024-10-01T02:37:11.233ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49512024-10-01T02:37:11.233ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1536e824-9ba8-49c4-a096-efd0350165bb", "content-length": "26", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
49522024-10-01T02:37:11.233ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49532024-10-01T02:37:11.234ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
49542024-10-01T02:37:11.265ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
49552024-10-01T02:37:11.265ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 231.131733ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
49562024-10-01T02:37:11.274ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 240.342597ms iteration = 11 status = {"physical_disks_added":0}
49572024-10-01T02:37:11.294ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49582024-10-01T02:37:11.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49592024-10-01T02:37:11.323ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49602024-10-01T02:37:11.324ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
49612024-10-01T02:37:11.324ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49622024-10-01T02:37:11.324ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49632024-10-01T02:37:11.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49642024-10-01T02:37:11.325ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6498f20d-a547-4fc4-8e27-fca82fd05b25", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49652024-10-01T02:37:11.325ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49662024-10-01T02:37:11.327ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49672024-10-01T02:37:11.327ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d719283f-80ad-47d6-b559-90d566f06197", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49682024-10-01T02:37:11.327ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49692024-10-01T02:37:11.328ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49702024-10-01T02:37:11.328ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49712024-10-01T02:37:11.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49722024-10-01T02:37:11.329ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49732024-10-01T02:37:11.329ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 295.97948ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
49742024-10-01T02:37:11.349ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
49752024-10-01T02:37:11.358ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
49762024-10-01T02:37:11.358ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "96b16b18-684f-4b7a-b10b-7f30e2d636b1", "content-length": "2", "date": "Tue, 01 Oct 2024 02:37:10 GMT"} })
49772024-10-01T02:37:11.359ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49782024-10-01T02:37:11.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49792024-10-01T02:37:11.466ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
49802024-10-01T02:37:11.467ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d76151ba-ed42-44d5-a87d-ea1776cd2b58", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
49812024-10-01T02:37:11.467ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
49822024-10-01T02:37:11.469ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "86be5efd-7d89-4e96-9520-6d5e782925ef", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
49832024-10-01T02:37:11.469ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
49842024-10-01T02:37:11.471ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ab5bd5b9-527b-490b-9bbf-738033bfbf5b", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
49852024-10-01T02:37:11.471ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
49862024-10-01T02:37:11.477ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 444.122572ms iteration = 9 status = {}
49872024-10-01T02:37:11.477ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
49882024-10-01T02:37:11.478ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 444.651401ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
49892024-10-01T02:37:11.478ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49902024-10-01T02:37:11.480ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "17912703-d013-46e1-9415-1045175ebdb1", "content-length": "372", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
49912024-10-01T02:37:11.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49922024-10-01T02:37:11.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49932024-10-01T02:37:11.483ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 450.013131ms iteration = 9 status = null
49942024-10-01T02:37:11.483ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49952024-10-01T02:37:11.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49962024-10-01T02:37:11.488ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49972024-10-01T02:37:11.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49982024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49992024-10-01T02:37:11.496ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c639be97-8d2d-4e74-b829-f36d21867797", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
50002024-10-01T02:37:11.498ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 464.135237ms iteration = 9 status = {}
50012024-10-01T02:37:11.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50022024-10-01T02:37:11.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50032024-10-01T02:37:11.554ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
50042024-10-01T02:37:11.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50052024-10-01T02:37:11.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50062024-10-01T02:37:11.574ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50072024-10-01T02:37:11.576ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2531752-2e9c-4d71-a28f-7ab2ac163508", "content-length": "121", "date": "Tue, 01 Oct 2024 02:37:10 GMT"} })
50082024-10-01T02:37:11.576ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
50092024-10-01T02:37:11.576ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
50102024-10-01T02:37:11.578ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50112024-10-01T02:37:11.578ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50122024-10-01T02:37:11.578ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
50132024-10-01T02:37:11.578ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
50142024-10-01T02:37:11.578ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
50152024-10-01T02:37:11.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50162024-10-01T02:37:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50172024-10-01T02:37:11.580ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
50182024-10-01T02:37:11.580ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "918fd69d-3e7b-445d-9590-5ccf9f2ac81d", "content-length": "2", "date": "Tue, 01 Oct 2024 02:37:10 GMT"} })
50192024-10-01T02:37:11.580ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
50202024-10-01T02:37:11.581ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a62a143e-6d62-403c-aba2-550b78d63b28", "content-length": "52", "date": "Tue, 01 Oct 2024 02:37:10 GMT"} })
50212024-10-01T02:37:11.581ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
50222024-10-01T02:37:11.581ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
50232024-10-01T02:37:11.614ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50242024-10-01T02:37:11.687ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0719290e-33d7-41d8-96db-bca964a90e09", "content-length": "691", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
50252024-10-01T02:37:11.687ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
50262024-10-01T02:37:11.687ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
50272024-10-01T02:37:11.687ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
50282024-10-01T02:37:11.688ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 654.442276ms iteration = 9 status = {}
50292024-10-01T02:37:11.768ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 398 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = dd0d6f42-38c1-4f74-aed7-69709c207b38 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
50302024-10-01T02:37:11.789ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5012be57-14cc-4bf6-991d-8276b6f70582", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
50312024-10-01T02:37:11.789ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
50322024-10-01T02:37:11.789ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
50332024-10-01T02:37:11.791ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c94e7d1-aaba-4e43-a6e6-205ad8fa9e15", "content-length": "667", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
50342024-10-01T02:37:11.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50352024-10-01T02:37:11.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50362024-10-01T02:37:11.794ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50372024-10-01T02:37:11.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50382024-10-01T02:37:11.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50392024-10-01T02:37:11.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50402024-10-01T02:37:11.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50412024-10-01T02:37:11.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50422024-10-01T02:37:11.808ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 774.872674ms iteration = 9 status = {}
50432024-10-01T02:37:11.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6aca6875-6803-436b-a857-3435093f1344 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50442024-10-01T02:37:11.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6aca6875-6803-436b-a857-3435093f1344 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50452024-10-01T02:37:11.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6aca6875-6803-436b-a857-3435093f1344 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50462024-10-01T02:37:12.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ed9339ad-4b34-44d3-a503-968b92ed6773 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50472024-10-01T02:37:12.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ed9339ad-4b34-44d3-a503-968b92ed6773 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50482024-10-01T02:37:12.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ed9339ad-4b34-44d3-a503-968b92ed6773 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50492024-10-01T02:37:13.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bb2f642c-5184-43cf-9dc4-76105f5a50aa roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50502024-10-01T02:37:13.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bb2f642c-5184-43cf-9dc4-76105f5a50aa resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50512024-10-01T02:37:13.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bb2f642c-5184-43cf-9dc4-76105f5a50aa response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50522024-10-01T02:37:14.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f10401f9-d61e-43a5-83d3-459cb4595b95 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50532024-10-01T02:37:14.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f10401f9-d61e-43a5-83d3-459cb4595b95 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50542024-10-01T02:37:14.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f10401f9-d61e-43a5-83d3-459cb4595b95 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50552024-10-01T02:37:15.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = af927e15-dc22-49dd-97e3-4f3cd8e689da roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50562024-10-01T02:37:15.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = af927e15-dc22-49dd-97e3-4f3cd8e689da resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50572024-10-01T02:37:15.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = af927e15-dc22-49dd-97e3-4f3cd8e689da response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50582024-10-01T02:37:16.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b8574c81-f865-4c23-adb9-8ff8ac2c200a roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50592024-10-01T02:37:16.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b8574c81-f865-4c23-adb9-8ff8ac2c200a resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50602024-10-01T02:37:16.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b8574c81-f865-4c23-adb9-8ff8ac2c200a response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50612024-10-01T02:37:17.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2b051e23-ff06-4d2b-8488-c6c5443ad8c3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50622024-10-01T02:37:17.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2b051e23-ff06-4d2b-8488-c6c5443ad8c3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50632024-10-01T02:37:17.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2b051e23-ff06-4d2b-8488-c6c5443ad8c3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50642024-10-01T02:37:19.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bc740a7a-0e04-4535-983f-45b7001e60a0 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50652024-10-01T02:37:19.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bc740a7a-0e04-4535-983f-45b7001e60a0 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50662024-10-01T02:37:19.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1890 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bc740a7a-0e04-4535-983f-45b7001e60a0 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50672024-10-01T02:37:20.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bd1a0b67-57b0-47a6-8c69-358015723fb3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50682024-10-01T02:37:20.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bd1a0b67-57b0-47a6-8c69-358015723fb3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50692024-10-01T02:37:20.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2668 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bd1a0b67-57b0-47a6-8c69-358015723fb3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50702024-10-01T02:37:21.034ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
50712024-10-01T02:37:21.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
50722024-10-01T02:37:21.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50732024-10-01T02:37:21.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50742024-10-01T02:37:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50752024-10-01T02:37:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50762024-10-01T02:37:21.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50772024-10-01T02:37:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50782024-10-01T02:37:21.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50792024-10-01T02:37:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50802024-10-01T02:37:21.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50812024-10-01T02:37:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50822024-10-01T02:37:21.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50832024-10-01T02:37:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
50842024-10-01T02:37:21.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50852024-10-01T02:37:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50862024-10-01T02:37:21.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e5c2d637-5194-4621-8c82-12cebb746106 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50872024-10-01T02:37:21.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e5c2d637-5194-4621-8c82-12cebb746106 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50882024-10-01T02:37:21.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e5c2d637-5194-4621-8c82-12cebb746106 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50892024-10-01T02:37:21.055ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
50902024-10-01T02:37:21.055ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.373318ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
50912024-10-01T02:37:21.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50922024-10-01T02:37:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50932024-10-01T02:37:21.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 41.504165ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50942024-10-01T02:37:21.767ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 451 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = e65384f4-f4f2-4af9-9c03-e7576d0f71bd response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
50952024-10-01T02:37:22.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c39cdfcd-1589-43cd-9995-6082ab8d03fb roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50962024-10-01T02:37:22.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c39cdfcd-1589-43cd-9995-6082ab8d03fb resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50972024-10-01T02:37:22.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c39cdfcd-1589-43cd-9995-6082ab8d03fb response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50982024-10-01T02:37:23.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9ef4a024-da38-4784-aa48-b2a431ceea47 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
50992024-10-01T02:37:23.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9ef4a024-da38-4784-aa48-b2a431ceea47 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51002024-10-01T02:37:23.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9ef4a024-da38-4784-aa48-b2a431ceea47 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51012024-10-01T02:37:24.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 80dbd0d6-6317-4375-9ea1-52d43fb6858f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51022024-10-01T02:37:24.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 80dbd0d6-6317-4375-9ea1-52d43fb6858f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51032024-10-01T02:37:24.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 80dbd0d6-6317-4375-9ea1-52d43fb6858f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51042024-10-01T02:37:25.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 84494322-5032-48ee-96fa-b33b94deccd9 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51052024-10-01T02:37:25.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 84494322-5032-48ee-96fa-b33b94deccd9 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51062024-10-01T02:37:25.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 84494322-5032-48ee-96fa-b33b94deccd9 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51072024-10-01T02:37:26.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 94cfb9c2-8c79-4ca0-aa0f-6b22d93801dd roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51082024-10-01T02:37:26.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 94cfb9c2-8c79-4ca0-aa0f-6b22d93801dd resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51092024-10-01T02:37:26.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 94cfb9c2-8c79-4ca0-aa0f-6b22d93801dd response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51102024-10-01T02:37:27.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 16af4c23-3c11-4514-9c4f-b712cea98bd8 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51112024-10-01T02:37:27.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 16af4c23-3c11-4514-9c4f-b712cea98bd8 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51122024-10-01T02:37:27.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 16af4c23-3c11-4514-9c4f-b712cea98bd8 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51132024-10-01T02:37:28.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2b6ea347-c90a-418d-b7dd-8591c58ec3b3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51142024-10-01T02:37:28.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2b6ea347-c90a-418d-b7dd-8591c58ec3b3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51152024-10-01T02:37:28.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2818 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2b6ea347-c90a-418d-b7dd-8591c58ec3b3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51162024-10-01T02:37:29.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2cb65cf6-d321-44c1-a4db-f396977eca30 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51172024-10-01T02:37:29.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2cb65cf6-d321-44c1-a4db-f396977eca30 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51182024-10-01T02:37:29.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2837 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2cb65cf6-d321-44c1-a4db-f396977eca30 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51192024-10-01T02:37:30.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 697d74b8-85d1-4b87-bc40-e19e00ff07ad roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51202024-10-01T02:37:30.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 697d74b8-85d1-4b87-bc40-e19e00ff07ad resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51212024-10-01T02:37:30.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 697d74b8-85d1-4b87-bc40-e19e00ff07ad response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51222024-10-01T02:37:31.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
51232024-10-01T02:37:31.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51242024-10-01T02:37:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51252024-10-01T02:37:31.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
51262024-10-01T02:37:31.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51272024-10-01T02:37:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51282024-10-01T02:37:31.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51292024-10-01T02:37:31.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51302024-10-01T02:37:31.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51312024-10-01T02:37:31.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51322024-10-01T02:37:31.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51332024-10-01T02:37:31.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51342024-10-01T02:37:31.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51352024-10-01T02:37:31.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51362024-10-01T02:37:31.063ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.722919ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51372024-10-01T02:37:31.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51382024-10-01T02:37:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
51392024-10-01T02:37:31.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51402024-10-01T02:37:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51412024-10-01T02:37:31.078ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
51422024-10-01T02:37:31.078ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.490356ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
51432024-10-01T02:37:31.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a0dfed01-3db5-407c-8a0f-b67cfb428fb8 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51442024-10-01T02:37:31.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a0dfed01-3db5-407c-8a0f-b67cfb428fb8 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51452024-10-01T02:37:31.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1772 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a0dfed01-3db5-407c-8a0f-b67cfb428fb8 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51462024-10-01T02:37:31.768ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 375 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 7cbc70ef-072a-4aed-ac5d-a67ae3a76e5e response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
51472024-10-01T02:37:32.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 46348ee2-76fc-4348-959e-09b29bd10428 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51482024-10-01T02:37:32.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 46348ee2-76fc-4348-959e-09b29bd10428 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51492024-10-01T02:37:32.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 46348ee2-76fc-4348-959e-09b29bd10428 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51502024-10-01T02:37:33.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6b2856a5-b750-4844-9c74-2386a1cb1689 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51512024-10-01T02:37:33.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6b2856a5-b750-4844-9c74-2386a1cb1689 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51522024-10-01T02:37:33.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6b2856a5-b750-4844-9c74-2386a1cb1689 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51532024-10-01T02:37:34.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4afb4858-fb00-4cb4-8678-02b6a78ebb3d roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51542024-10-01T02:37:34.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4afb4858-fb00-4cb4-8678-02b6a78ebb3d resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51552024-10-01T02:37:34.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1884 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4afb4858-fb00-4cb4-8678-02b6a78ebb3d response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51562024-10-01T02:37:35.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a5a9d45b-5097-4918-993b-d21ba4edb413 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51572024-10-01T02:37:35.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a5a9d45b-5097-4918-993b-d21ba4edb413 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51582024-10-01T02:37:35.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1732 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a5a9d45b-5097-4918-993b-d21ba4edb413 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51592024-10-01T02:37:36.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e17e8a4c-a4a0-4bc0-9cca-ddf36b22630a roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51602024-10-01T02:37:36.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e17e8a4c-a4a0-4bc0-9cca-ddf36b22630a resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51612024-10-01T02:37:36.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e17e8a4c-a4a0-4bc0-9cca-ddf36b22630a response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51622024-10-01T02:37:37.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5cbe1e0a-ac73-403f-8aed-8132f9bda348 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51632024-10-01T02:37:37.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5cbe1e0a-ac73-403f-8aed-8132f9bda348 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51642024-10-01T02:37:37.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5cbe1e0a-ac73-403f-8aed-8132f9bda348 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51652024-10-01T02:37:38.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5e724ead-b4ef-47ae-92d0-e2b921bf453b roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51662024-10-01T02:37:38.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5e724ead-b4ef-47ae-92d0-e2b921bf453b resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51672024-10-01T02:37:38.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5e724ead-b4ef-47ae-92d0-e2b921bf453b response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51682024-10-01T02:37:39.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0c2c176a-539c-42bb-b0b4-80dfb22a4f86 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51692024-10-01T02:37:39.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0c2c176a-539c-42bb-b0b4-80dfb22a4f86 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51702024-10-01T02:37:39.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0c2c176a-539c-42bb-b0b4-80dfb22a4f86 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51712024-10-01T02:37:40.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8e16b753-54f5-4420-974a-d22debd9a217 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51722024-10-01T02:37:40.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8e16b753-54f5-4420-974a-d22debd9a217 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51732024-10-01T02:37:40.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8e16b753-54f5-4420-974a-d22debd9a217 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
51742024-10-01T02:37:41.033ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
51752024-10-01T02:37:41.033ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51762024-10-01T02:37:41.033ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
51772024-10-01T02:37:41.033ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
51782024-10-01T02:37:41.033ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
51792024-10-01T02:37:41.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
51802024-10-01T02:37:41.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51812024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
51822024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51832024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51842024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
51852024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
51862024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
51872024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51882024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
51892024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
51902024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51912024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51922024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51932024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
51942024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
51952024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
51962024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
51972024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
51982024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51992024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
52002024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52012024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
52022024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52032024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
52042024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52052024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
52062024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52072024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
52082024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
52092024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52102024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52112024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52122024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
52132024-10-01T02:37:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52142024-10-01T02:37:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
52152024-10-01T02:37:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52162024-10-01T02:37:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52172024-10-01T02:37:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52182024-10-01T02:37:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52192024-10-01T02:37:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52202024-10-01T02:37:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52212024-10-01T02:37:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52222024-10-01T02:37:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52232024-10-01T02:37:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52242024-10-01T02:37:41.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52252024-10-01T02:37:41.036ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1514, tv_nsec: 477319455 } })
52262024-10-01T02:37:41.036ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1514, tv_nsec: 477497208 } })
52272024-10-01T02:37:41.037ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
52282024-10-01T02:37:41.037ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.991307ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
52292024-10-01T02:37:41.037ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
52302024-10-01T02:37:41.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.102522ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
52312024-10-01T02:37:41.037ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52322024-10-01T02:37:41.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52332024-10-01T02:37:41.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52342024-10-01T02:37:41.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52352024-10-01T02:37:41.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52362024-10-01T02:37:41.040ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52372024-10-01T02:37:41.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52382024-10-01T02:37:41.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52392024-10-01T02:37:41.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52402024-10-01T02:37:41.044ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52412024-10-01T02:37:41.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52422024-10-01T02:37:41.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52432024-10-01T02:37:41.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52442024-10-01T02:37:41.046ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52452024-10-01T02:37:41.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52462024-10-01T02:37:41.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52472024-10-01T02:37:41.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
52482024-10-01T02:37:41.047ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52492024-10-01T02:37:41.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52502024-10-01T02:37:41.049ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52512024-10-01T02:37:41.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52522024-10-01T02:37:41.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52532024-10-01T02:37:41.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52542024-10-01T02:37:41.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52552024-10-01T02:37:41.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52562024-10-01T02:37:41.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52572024-10-01T02:37:41.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52582024-10-01T02:37:41.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52592024-10-01T02:37:41.092ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52602024-10-01T02:37:41.092ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.276976ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
52612024-10-01T02:37:41.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
52622024-10-01T02:37:41.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52632024-10-01T02:37:41.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52642024-10-01T02:37:41.094ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52652024-10-01T02:37:41.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52662024-10-01T02:37:41.095ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52672024-10-01T02:37:41.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52682024-10-01T02:37:41.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
52692024-10-01T02:37:41.096ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52702024-10-01T02:37:41.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52712024-10-01T02:37:41.096ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1514, tv_nsec: 537762098 } })
52722024-10-01T02:37:41.097ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
52732024-10-01T02:37:41.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.733895ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52742024-10-01T02:37:41.103ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52752024-10-01T02:37:41.103ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
52762024-10-01T02:37:41.103ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52772024-10-01T02:37:41.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52782024-10-01T02:37:41.110ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
52792024-10-01T02:37:41.110ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.027324ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
52802024-10-01T02:37:41.123ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52812024-10-01T02:37:41.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52822024-10-01T02:37:41.125ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52832024-10-01T02:37:41.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52842024-10-01T02:37:41.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52852024-10-01T02:37:41.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
52862024-10-01T02:37:41.131ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52872024-10-01T02:37:41.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52882024-10-01T02:37:41.135ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
52892024-10-01T02:37:41.135ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52902024-10-01T02:37:41.135ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "482e9c45-b822-400a-9234-5902e85990d4", "content-length": "26", "date": "Tue, 01 Oct 2024 02:37:41 GMT"} })
52912024-10-01T02:37:41.135ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52922024-10-01T02:37:41.137ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52932024-10-01T02:37:41.138ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.976882ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
52942024-10-01T02:37:41.151ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
52952024-10-01T02:37:41.151ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52962024-10-01T02:37:41.151ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "da0dbf0c-8c19-4769-97b3-3575c2fa1a1d", "content-length": "26", "date": "Tue, 01 Oct 2024 02:37:41 GMT"} })
52972024-10-01T02:37:41.151ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52982024-10-01T02:37:41.153ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52992024-10-01T02:37:41.165ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53002024-10-01T02:37:41.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53012024-10-01T02:37:41.195ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53022024-10-01T02:37:41.196ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c83b3397-4307-4dd2-ae06-3b2ea60a3385", "content-length": "372", "date": "Tue, 01 Oct 2024 02:37:41 GMT"} })
53032024-10-01T02:37:41.196ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53042024-10-01T02:37:41.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53052024-10-01T02:37:41.199ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53062024-10-01T02:37:41.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53072024-10-01T02:37:41.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53082024-10-01T02:37:41.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53092024-10-01T02:37:41.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53102024-10-01T02:37:41.206ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
53112024-10-01T02:37:41.206ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53122024-10-01T02:37:41.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53132024-10-01T02:37:41.206ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6041c309-67ac-4748-b1f1-7a0430fb5fd3", "content-length": "26", "date": "Tue, 01 Oct 2024 02:37:41 GMT"} })
53142024-10-01T02:37:41.206ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53152024-10-01T02:37:41.208ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
53162024-10-01T02:37:41.208ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 175.125095ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
53172024-10-01T02:37:41.208ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
53182024-10-01T02:37:41.209ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53192024-10-01T02:37:41.210ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a2afa48b-cb28-4171-954b-7ebbee2f9752", "date": "Tue, 01 Oct 2024 02:37:41 GMT"} })
53202024-10-01T02:37:41.211ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 177.305812ms iteration = 10 status = {}
53212024-10-01T02:37:41.221ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53222024-10-01T02:37:41.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53232024-10-01T02:37:41.226ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53242024-10-01T02:37:41.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53252024-10-01T02:37:41.227ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53262024-10-01T02:37:41.229ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53272024-10-01T02:37:41.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53282024-10-01T02:37:41.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
53292024-10-01T02:37:41.231ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53302024-10-01T02:37:41.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53312024-10-01T02:37:41.231ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53322024-10-01T02:37:41.231ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
53332024-10-01T02:37:41.231ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53342024-10-01T02:37:41.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53352024-10-01T02:37:41.233ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 198.582708ms iteration = 10 status = 0
53362024-10-01T02:37:41.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 199.928811ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
53372024-10-01T02:37:41.238ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 205.071847ms iteration = 10 status = {}
53382024-10-01T02:37:41.249ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
53392024-10-01T02:37:41.249ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1f9d224-57b9-4780-a71b-4351e5d8107c", "content-length": "2", "date": "Tue, 01 Oct 2024 02:37:40 GMT"} })
53402024-10-01T02:37:41.250ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53412024-10-01T02:37:41.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53422024-10-01T02:37:41.252ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 219.312395ms iteration = 10 status = null
53432024-10-01T02:37:41.261ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53442024-10-01T02:37:41.261ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
53452024-10-01T02:37:41.261ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 226.635788ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
53462024-10-01T02:37:41.262ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 227.871698ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
53472024-10-01T02:37:41.294ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53482024-10-01T02:37:41.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53492024-10-01T02:37:41.301ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 266.732149ms iteration = 12 status = {"physical_disks_added":0}
53502024-10-01T02:37:41.320ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53512024-10-01T02:37:41.322ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53522024-10-01T02:37:41.322ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53532024-10-01T02:37:41.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53542024-10-01T02:37:41.324ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53552024-10-01T02:37:41.326ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53562024-10-01T02:37:41.326ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53572024-10-01T02:37:41.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53582024-10-01T02:37:41.330ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53592024-10-01T02:37:41.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53602024-10-01T02:37:41.333ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
53612024-10-01T02:37:41.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53622024-10-01T02:37:41.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53632024-10-01T02:37:41.346ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
53642024-10-01T02:37:41.347ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2b30e02-cca2-4d2a-95ff-af455aeeb862", "content-length": "121", "date": "Tue, 01 Oct 2024 02:37:40 GMT"} })
53652024-10-01T02:37:41.347ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
53662024-10-01T02:37:41.347ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
53672024-10-01T02:37:41.347ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
53682024-10-01T02:37:41.347ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
53692024-10-01T02:37:41.347ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
53702024-10-01T02:37:41.347ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
53712024-10-01T02:37:41.347ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
53722024-10-01T02:37:41.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53732024-10-01T02:37:41.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53742024-10-01T02:37:41.350ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
53752024-10-01T02:37:41.350ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "49ef8168-c890-468b-a897-87a34b124c8a", "content-length": "2", "date": "Tue, 01 Oct 2024 02:37:40 GMT"} })
53762024-10-01T02:37:41.350ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
53772024-10-01T02:37:41.350ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6dd186c6-9954-4dbe-b8ac-f2573c0b3aa9", "content-length": "52", "date": "Tue, 01 Oct 2024 02:37:40 GMT"} })
53782024-10-01T02:37:41.350ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
53792024-10-01T02:37:41.350ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
53802024-10-01T02:37:41.417ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
53812024-10-01T02:37:41.446ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "06dcd33f-e7fc-44e5-aced-e7622a6d4907", "date": "Tue, 01 Oct 2024 02:37:41 GMT"} })
53822024-10-01T02:37:41.446ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
53832024-10-01T02:37:41.446ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
53842024-10-01T02:37:41.447ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "46fce393-96ea-4e17-a00f-cbda5689e3d6", "content-length": "691", "date": "Tue, 01 Oct 2024 02:37:41 GMT"} })
53852024-10-01T02:37:41.447ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
53862024-10-01T02:37:41.447ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
53872024-10-01T02:37:41.447ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
53882024-10-01T02:37:41.448ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 414.031378ms iteration = 10 status = {}
53892024-10-01T02:37:41.448ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a6a4850-0ce4-4758-8bec-29f3b8a49c1a", "content-length": "667", "date": "Tue, 01 Oct 2024 02:37:41 GMT"} })
53902024-10-01T02:37:41.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53912024-10-01T02:37:41.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53922024-10-01T02:37:41.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53932024-10-01T02:37:41.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53942024-10-01T02:37:41.455ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53952024-10-01T02:37:41.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53962024-10-01T02:37:41.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53972024-10-01T02:37:41.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53982024-10-01T02:37:41.464ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 429.910034ms iteration = 10 status = {}
53992024-10-01T02:37:41.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 19cc73d9-1935-481c-8b60-b7047399a8d0 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54002024-10-01T02:37:41.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 19cc73d9-1935-481c-8b60-b7047399a8d0 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54012024-10-01T02:37:41.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 19cc73d9-1935-481c-8b60-b7047399a8d0 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54022024-10-01T02:37:41.768ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 396 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 3637c051-3480-417d-a987-2798ab0f7d6b response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
54032024-10-01T02:37:42.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a337e065-2b51-4407-a0bb-c66331b1d47b roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54042024-10-01T02:37:42.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a337e065-2b51-4407-a0bb-c66331b1d47b resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54052024-10-01T02:37:42.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a337e065-2b51-4407-a0bb-c66331b1d47b response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54062024-10-01T02:37:43.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e5dd8933-0aaf-4e54-b212-c70ced4f7468 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54072024-10-01T02:37:43.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e5dd8933-0aaf-4e54-b212-c70ced4f7468 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54082024-10-01T02:37:43.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e5dd8933-0aaf-4e54-b212-c70ced4f7468 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54092024-10-01T02:37:44.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0136895e-ebde-4e04-b5d7-f786fbc5d489 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54102024-10-01T02:37:44.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0136895e-ebde-4e04-b5d7-f786fbc5d489 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54112024-10-01T02:37:44.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0136895e-ebde-4e04-b5d7-f786fbc5d489 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54122024-10-01T02:37:45.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cd5a8e38-7ce0-4f7d-b5af-b9db8935c409 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54132024-10-01T02:37:45.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cd5a8e38-7ce0-4f7d-b5af-b9db8935c409 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54142024-10-01T02:37:45.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cd5a8e38-7ce0-4f7d-b5af-b9db8935c409 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54152024-10-01T02:37:46.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 97750309-e8dc-43a5-ac52-8bcc5b35a8b2 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54162024-10-01T02:37:46.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 97750309-e8dc-43a5-ac52-8bcc5b35a8b2 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54172024-10-01T02:37:46.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 97750309-e8dc-43a5-ac52-8bcc5b35a8b2 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54182024-10-01T02:37:47.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 59df9d99-3e8d-46ad-8315-d29f23625b1a roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54192024-10-01T02:37:47.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 59df9d99-3e8d-46ad-8315-d29f23625b1a resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54202024-10-01T02:37:47.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 59df9d99-3e8d-46ad-8315-d29f23625b1a response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54212024-10-01T02:37:48.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f8dcf7cc-a1f8-4717-a6d2-8aa394b5b991 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54222024-10-01T02:37:48.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f8dcf7cc-a1f8-4717-a6d2-8aa394b5b991 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54232024-10-01T02:37:48.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f8dcf7cc-a1f8-4717-a6d2-8aa394b5b991 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54242024-10-01T02:37:49.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 114998fb-6c29-4120-ba06-8076aaf09e2c roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54252024-10-01T02:37:49.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 114998fb-6c29-4120-ba06-8076aaf09e2c resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54262024-10-01T02:37:49.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1805 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 114998fb-6c29-4120-ba06-8076aaf09e2c response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54272024-10-01T02:37:50.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bef6fa4b-fa60-4ecf-ada1-85f1fb410afa roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54282024-10-01T02:37:50.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bef6fa4b-fa60-4ecf-ada1-85f1fb410afa resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54292024-10-01T02:37:50.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = bef6fa4b-fa60-4ecf-ada1-85f1fb410afa response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54302024-10-01T02:37:51.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
54312024-10-01T02:37:51.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54322024-10-01T02:37:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54332024-10-01T02:37:51.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
54342024-10-01T02:37:51.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54352024-10-01T02:37:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54362024-10-01T02:37:51.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54372024-10-01T02:37:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54382024-10-01T02:37:51.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54392024-10-01T02:37:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54402024-10-01T02:37:51.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54412024-10-01T02:37:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54422024-10-01T02:37:51.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54432024-10-01T02:37:51.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54442024-10-01T02:37:51.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.538305ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54452024-10-01T02:37:51.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54462024-10-01T02:37:51.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
54472024-10-01T02:37:51.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54482024-10-01T02:37:51.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54492024-10-01T02:37:51.088ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
54502024-10-01T02:37:51.088ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.2763ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
54512024-10-01T02:37:51.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7369ebfa-0de6-4bd1-8e5b-9fd821985b28 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54522024-10-01T02:37:51.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7369ebfa-0de6-4bd1-8e5b-9fd821985b28 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54532024-10-01T02:37:51.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1735 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7369ebfa-0de6-4bd1-8e5b-9fd821985b28 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54542024-10-01T02:37:51.768ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 855 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 1134cd89-5e30-43b8-870b-4690ae39d8e8 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
54552024-10-01T02:37:52.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = eb035214-d613-4964-84cb-6ca6d041bc62 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54562024-10-01T02:37:52.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = eb035214-d613-4964-84cb-6ca6d041bc62 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54572024-10-01T02:37:52.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = eb035214-d613-4964-84cb-6ca6d041bc62 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54582024-10-01T02:37:53.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 161ba8ba-a8da-464e-8b10-9b812e9a1991 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54592024-10-01T02:37:53.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 161ba8ba-a8da-464e-8b10-9b812e9a1991 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54602024-10-01T02:37:53.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1620 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 161ba8ba-a8da-464e-8b10-9b812e9a1991 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54612024-10-01T02:37:54.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9722b7da-3cda-4433-8d41-5014cb27054d roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54622024-10-01T02:37:54.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9722b7da-3cda-4433-8d41-5014cb27054d resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54632024-10-01T02:37:54.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1778 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9722b7da-3cda-4433-8d41-5014cb27054d response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54642024-10-01T02:37:55.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 98c71cc9-c650-4c4a-8cdd-e55b5f0bfab4 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54652024-10-01T02:37:55.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 98c71cc9-c650-4c4a-8cdd-e55b5f0bfab4 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54662024-10-01T02:37:55.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 98c71cc9-c650-4c4a-8cdd-e55b5f0bfab4 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54672024-10-01T02:37:56.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cca70756-367b-41ee-b42b-ee1d130f24b5 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54682024-10-01T02:37:56.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cca70756-367b-41ee-b42b-ee1d130f24b5 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54692024-10-01T02:37:56.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cca70756-367b-41ee-b42b-ee1d130f24b5 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54702024-10-01T02:37:57.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a2b5d0f8-9728-4ccb-a124-eab9bc5f9446 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54712024-10-01T02:37:57.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a2b5d0f8-9728-4ccb-a124-eab9bc5f9446 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54722024-10-01T02:37:57.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a2b5d0f8-9728-4ccb-a124-eab9bc5f9446 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54732024-10-01T02:37:58.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 35052196-78d0-485a-aa7f-43adb5b1afca roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54742024-10-01T02:37:58.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 35052196-78d0-485a-aa7f-43adb5b1afca resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54752024-10-01T02:37:58.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 35052196-78d0-485a-aa7f-43adb5b1afca response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54762024-10-01T02:37:59.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 496b040c-2634-4201-8269-10fafcc1a11e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54772024-10-01T02:37:59.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 496b040c-2634-4201-8269-10fafcc1a11e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54782024-10-01T02:37:59.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 496b040c-2634-4201-8269-10fafcc1a11e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54792024-10-01T02:38:00.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fecae3c4-a7ea-4dec-941f-43b3971e8bbf roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54802024-10-01T02:38:00.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fecae3c4-a7ea-4dec-941f-43b3971e8bbf resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54812024-10-01T02:38:00.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fecae3c4-a7ea-4dec-941f-43b3971e8bbf response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
54822024-10-01T02:38:01.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
54832024-10-01T02:38:01.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54842024-10-01T02:38:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54852024-10-01T02:38:01.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
54862024-10-01T02:38:01.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54872024-10-01T02:38:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54882024-10-01T02:38:01.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54892024-10-01T02:38:01.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54902024-10-01T02:38:01.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54912024-10-01T02:38:01.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54922024-10-01T02:38:01.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54932024-10-01T02:38:01.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54942024-10-01T02:38:01.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54952024-10-01T02:38:01.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54962024-10-01T02:38:01.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54972024-10-01T02:38:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
54982024-10-01T02:38:01.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54992024-10-01T02:38:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55002024-10-01T02:38:01.077ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
55012024-10-01T02:38:01.077ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.329106ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
55022024-10-01T02:38:01.093ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.997779ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55032024-10-01T02:38:01.768ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 619 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 870e202b-f953-45be-b6f8-c335ffd2b034 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
55042024-10-01T02:38:01.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b172e55f-ad6e-470a-ae80-3469ff1c6588 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55052024-10-01T02:38:01.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b172e55f-ad6e-470a-ae80-3469ff1c6588 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55062024-10-01T02:38:01.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b172e55f-ad6e-470a-ae80-3469ff1c6588 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55072024-10-01T02:38:02.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1c01a976-8545-468b-915d-cc702451f424 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55082024-10-01T02:38:02.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1c01a976-8545-468b-915d-cc702451f424 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55092024-10-01T02:38:02.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1c01a976-8545-468b-915d-cc702451f424 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55102024-10-01T02:38:03.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 525e253e-5be4-41d8-a221-0f6f5c0f6351 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55112024-10-01T02:38:03.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 525e253e-5be4-41d8-a221-0f6f5c0f6351 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55122024-10-01T02:38:03.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 525e253e-5be4-41d8-a221-0f6f5c0f6351 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55132024-10-01T02:38:05.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cbd243cf-caa3-4d65-96e8-ecad5a5b194d roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55142024-10-01T02:38:05.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cbd243cf-caa3-4d65-96e8-ecad5a5b194d resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55152024-10-01T02:38:05.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2136 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cbd243cf-caa3-4d65-96e8-ecad5a5b194d response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55162024-10-01T02:38:06.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f5e88a1d-abee-4d63-b7b0-4f489e7572dd roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55172024-10-01T02:38:06.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f5e88a1d-abee-4d63-b7b0-4f489e7572dd resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55182024-10-01T02:38:06.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f5e88a1d-abee-4d63-b7b0-4f489e7572dd response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55192024-10-01T02:38:07.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 595055ba-223d-4aa9-b5d9-a9a33e92680a roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55202024-10-01T02:38:07.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 595055ba-223d-4aa9-b5d9-a9a33e92680a resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55212024-10-01T02:38:07.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 595055ba-223d-4aa9-b5d9-a9a33e92680a response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55222024-10-01T02:38:08.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f1d5d9b4-9111-429c-86ae-aae510dd8347 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55232024-10-01T02:38:08.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f1d5d9b4-9111-429c-86ae-aae510dd8347 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55242024-10-01T02:38:08.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f1d5d9b4-9111-429c-86ae-aae510dd8347 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55252024-10-01T02:38:09.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5711a05a-1801-42dd-9b47-f58a64481a23 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55262024-10-01T02:38:09.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5711a05a-1801-42dd-9b47-f58a64481a23 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55272024-10-01T02:38:09.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5711a05a-1801-42dd-9b47-f58a64481a23 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55282024-10-01T02:38:10.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ee81018c-e9fe-4ef4-9384-c1efd2abe24e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55292024-10-01T02:38:10.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ee81018c-e9fe-4ef4-9384-c1efd2abe24e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55302024-10-01T02:38:10.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1849 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ee81018c-e9fe-4ef4-9384-c1efd2abe24e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
55312024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
55322024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55332024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
55342024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
55352024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55362024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
55372024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
55382024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
55392024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
55402024-10-01T02:38:11.034ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07
55412024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55422024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.81\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07"}
55432024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
55442024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
55452024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
55462024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55472024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
55482024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
55492024-10-01T02:38:11.034ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-01 02:28:11.034346392 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
55502024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
55512024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
55522024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
55532024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
55542024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
55552024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55562024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
55572024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
55582024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55592024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
55602024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
55612024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
55622024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55632024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
55642024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55652024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55662024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
55672024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55682024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
55692024-10-01T02:38:11.034ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
55702024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
55712024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
55722024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55732024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
55742024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
55752024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
55762024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
55772024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55782024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
55792024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55802024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
55812024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55822024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
55832024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
55842024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55852024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
55862024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
55872024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
55882024-10-01T02:38:11.034ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
55892024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55902024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
55912024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
55922024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
55932024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
55942024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55952024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55962024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55972024-10-01T02:38:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
55982024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55992024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
56002024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56012024-10-01T02:38:11.035ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 475613026 } })
56022024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56032024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56042024-10-01T02:38:11.035ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 475672187 } })
56052024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56062024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
56072024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
56082024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56092024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
56102024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56112024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56122024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56132024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56142024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
56152024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56162024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56172024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56182024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
56192024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56202024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
56212024-10-01T02:38:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56222024-10-01T02:38:11.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56232024-10-01T02:38:11.037ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
56242024-10-01T02:38:11.037ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.999201ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
56252024-10-01T02:38:11.037ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
56262024-10-01T02:38:11.037ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.115932ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
56272024-10-01T02:38:11.037ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56282024-10-01T02:38:11.038ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.334262ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56292024-10-01T02:38:11.038ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 479543732 } })
56302024-10-01T02:38:11.039ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 479703415 } })
56312024-10-01T02:38:11.039ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-01 02:28:11.034346392 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
56322024-10-01T02:38:11.039ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.061905ms iteration = 6 status = {"expiration":"2024-10-01T02:28:11.034346392Z","pruned":[]}
56332024-10-01T02:38:11.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
56342024-10-01T02:38:11.039ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56352024-10-01T02:38:11.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56362024-10-01T02:38:11.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56372024-10-01T02:38:11.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56382024-10-01T02:38:11.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56392024-10-01T02:38:11.040ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
56402024-10-01T02:38:11.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56412024-10-01T02:38:11.040ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
56422024-10-01T02:38:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56432024-10-01T02:38:11.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56442024-10-01T02:38:11.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56452024-10-01T02:38:11.041ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56462024-10-01T02:38:11.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56472024-10-01T02:38:11.042ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56482024-10-01T02:38:11.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56492024-10-01T02:38:11.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56502024-10-01T02:38:11.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56512024-10-01T02:38:11.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
56522024-10-01T02:38:11.045ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
56532024-10-01T02:38:11.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
56542024-10-01T02:38:11.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
56552024-10-01T02:38:11.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56562024-10-01T02:38:11.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56572024-10-01T02:38:11.047ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56582024-10-01T02:38:11.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56592024-10-01T02:38:11.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56602024-10-01T02:38:11.049ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56612024-10-01T02:38:11.050ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56622024-10-01T02:38:11.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56632024-10-01T02:38:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56642024-10-01T02:38:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
56652024-10-01T02:38:11.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56662024-10-01T02:38:11.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56672024-10-01T02:38:11.056ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.069059ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
56682024-10-01T02:38:11.057ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56692024-10-01T02:38:11.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56702024-10-01T02:38:11.058ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56712024-10-01T02:38:11.058ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56722024-10-01T02:38:11.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56732024-10-01T02:38:11.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56742024-10-01T02:38:11.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56752024-10-01T02:38:11.060ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56762024-10-01T02:38:11.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56772024-10-01T02:38:11.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56782024-10-01T02:38:11.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56792024-10-01T02:38:11.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56802024-10-01T02:38:11.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56812024-10-01T02:38:11.066ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56822024-10-01T02:38:11.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56832024-10-01T02:38:11.068ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56842024-10-01T02:38:11.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56852024-10-01T02:38:11.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56862024-10-01T02:38:11.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56872024-10-01T02:38:11.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
56882024-10-01T02:38:11.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56892024-10-01T02:38:11.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56902024-10-01T02:38:11.077ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56912024-10-01T02:38:11.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56922024-10-01T02:38:11.079ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56932024-10-01T02:38:11.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56942024-10-01T02:38:11.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56952024-10-01T02:38:11.105ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.935259ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
56962024-10-01T02:38:11.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
56972024-10-01T02:38:11.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56982024-10-01T02:38:11.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56992024-10-01T02:38:11.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57002024-10-01T02:38:11.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57012024-10-01T02:38:11.108ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
57022024-10-01T02:38:11.108ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
57032024-10-01T02:38:11.108ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.712636ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
57042024-10-01T02:38:11.109ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57052024-10-01T02:38:11.109ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 74.384546ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
57062024-10-01T02:38:11.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57072024-10-01T02:38:11.110ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57082024-10-01T02:38:11.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57092024-10-01T02:38:11.112ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 553425080 } })
57102024-10-01T02:38:11.113ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
57112024-10-01T02:38:11.114ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 80.124323ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
57122024-10-01T02:38:11.115ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57132024-10-01T02:38:11.115ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
57142024-10-01T02:38:11.115ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57152024-10-01T02:38:11.115ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57162024-10-01T02:38:11.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57172024-10-01T02:38:11.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57182024-10-01T02:38:11.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.161164ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57192024-10-01T02:38:11.119ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
57202024-10-01T02:38:11.119ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
57212024-10-01T02:38:11.119ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57222024-10-01T02:38:11.119ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
57232024-10-01T02:38:11.119ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 85.132346ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
57242024-10-01T02:38:11.119ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57252024-10-01T02:38:11.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57262024-10-01T02:38:11.120ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 86.359958ms iteration = 13 status = {"physical_disks_added":0}
57272024-10-01T02:38:11.120ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
57282024-10-01T02:38:11.120ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.704683ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
57292024-10-01T02:38:11.122ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57302024-10-01T02:38:11.122ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
57312024-10-01T02:38:11.122ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 88.352471ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
57322024-10-01T02:38:11.125ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
57332024-10-01T02:38:11.125ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
57342024-10-01T02:38:11.125ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
57352024-10-01T02:38:11.125ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57362024-10-01T02:38:11.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57372024-10-01T02:38:11.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57382024-10-01T02:38:11.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
57392024-10-01T02:38:11.131ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57402024-10-01T02:38:11.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57412024-10-01T02:38:11.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57422024-10-01T02:38:11.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
57432024-10-01T02:38:11.135ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57442024-10-01T02:38:11.135ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
57452024-10-01T02:38:11.135ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 101.316298ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
57462024-10-01T02:38:11.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57472024-10-01T02:38:11.136ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57482024-10-01T02:38:11.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57492024-10-01T02:38:11.139ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57502024-10-01T02:38:11.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
57512024-10-01T02:38:11.142ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57522024-10-01T02:38:11.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57532024-10-01T02:38:11.144ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 110.44316ms iteration = 11 status = 0
57542024-10-01T02:38:11.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3b528d2e-ffef-4710-93e5-51e33b22c6fc roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
57552024-10-01T02:38:11.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3b528d2e-ffef-4710-93e5-51e33b22c6fc resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
57562024-10-01T02:38:11.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3b528d2e-ffef-4710-93e5-51e33b22c6fc response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
57572024-10-01T02:38:11.161ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 126.735634ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57582024-10-01T02:38:11.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57592024-10-01T02:38:11.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57602024-10-01T02:38:11.162ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
57612024-10-01T02:38:11.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
57622024-10-01T02:38:11.165ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57632024-10-01T02:38:11.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57642024-10-01T02:38:11.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57652024-10-01T02:38:11.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57662024-10-01T02:38:11.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57672024-10-01T02:38:11.171ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57682024-10-01T02:38:11.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
57692024-10-01T02:38:11.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57702024-10-01T02:38:11.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57712024-10-01T02:38:11.174ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
57722024-10-01T02:38:11.174ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
57732024-10-01T02:38:11.174ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
57742024-10-01T02:38:11.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57752024-10-01T02:38:11.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
57762024-10-01T02:38:11.174ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57772024-10-01T02:38:11.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57782024-10-01T02:38:11.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57792024-10-01T02:38:11.176ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57802024-10-01T02:38:11.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57812024-10-01T02:38:11.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57822024-10-01T02:38:11.177ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57832024-10-01T02:38:11.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57842024-10-01T02:38:11.179ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57852024-10-01T02:38:11.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
57862024-10-01T02:38:11.179ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57872024-10-01T02:38:11.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57882024-10-01T02:38:11.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57892024-10-01T02:38:11.179ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57902024-10-01T02:38:11.181ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57912024-10-01T02:38:11.181ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
57922024-10-01T02:38:11.181ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 0 version = 2
57932024-10-01T02:38:11.181ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57942024-10-01T02:38:11.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57952024-10-01T02:38:11.182ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57962024-10-01T02:38:11.182ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
57972024-10-01T02:38:11.182ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57982024-10-01T02:38:11.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57992024-10-01T02:38:11.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
58002024-10-01T02:38:11.184ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58012024-10-01T02:38:11.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58022024-10-01T02:38:11.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58032024-10-01T02:38:11.185ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58042024-10-01T02:38:11.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58052024-10-01T02:38:11.187ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
58062024-10-01T02:38:11.187ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 1 version = 2
58072024-10-01T02:38:11.187ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
58082024-10-01T02:38:11.187ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-01 02:33:13.765844 UTC dns_group = external generation = 2
58092024-10-01T02:38:11.187ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 153.30691ms iteration = 6 status = {"generation":2}
58102024-10-01T02:38:11.187ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58112024-10-01T02:38:11.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58122024-10-01T02:38:11.189ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
58132024-10-01T02:38:11.189ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58142024-10-01T02:38:11.189ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "65054ce7-55b9-4aec-bf9e-c1e6c5366022", "content-length": "26", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
58152024-10-01T02:38:11.189ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58162024-10-01T02:38:11.189ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58172024-10-01T02:38:11.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58182024-10-01T02:38:11.191ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58192024-10-01T02:38:11.191ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58202024-10-01T02:38:11.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58212024-10-01T02:38:11.193ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58222024-10-01T02:38:11.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58232024-10-01T02:38:11.199ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 164.949434ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
58242024-10-01T02:38:11.209ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58252024-10-01T02:38:11.209ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
58262024-10-01T02:38:11.209ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
58272024-10-01T02:38:11.209ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58282024-10-01T02:38:11.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58292024-10-01T02:38:11.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58302024-10-01T02:38:11.213ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
58312024-10-01T02:38:11.213ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58322024-10-01T02:38:11.213ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "17f64993-3a8d-4fbd-a5af-6f291951f269", "content-length": "26", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
58332024-10-01T02:38:11.213ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58342024-10-01T02:38:11.215ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58352024-10-01T02:38:11.224ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58362024-10-01T02:38:11.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58372024-10-01T02:38:11.226ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-01T02:33:09.142901Z, time_modified: 2024-10-01T02:33:09.142901Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }) }
58382024-10-01T02:38:11.226ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 192.446096ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]}},"default_endpoint":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
58392024-10-01T02:38:11.248ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
58402024-10-01T02:38:11.248ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 214.301581ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
58412024-10-01T02:38:11.290ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
58422024-10-01T02:38:11.337ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
58432024-10-01T02:38:11.370ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58442024-10-01T02:38:11.370ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c3ff38c-2e0f-40f0-a5fd-c0b2226049ca", "content-length": "372", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
58452024-10-01T02:38:11.370ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58462024-10-01T02:38:11.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58472024-10-01T02:38:11.370ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 336.5553ms iteration = 11 status = {}
58482024-10-01T02:38:11.372ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58492024-10-01T02:38:11.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58502024-10-01T02:38:11.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58512024-10-01T02:38:11.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58522024-10-01T02:38:11.374ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58532024-10-01T02:38:11.377ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58542024-10-01T02:38:11.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58552024-10-01T02:38:11.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
58562024-10-01T02:38:11.377ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58572024-10-01T02:38:11.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58582024-10-01T02:38:11.379ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58592024-10-01T02:38:11.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58602024-10-01T02:38:11.380ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58612024-10-01T02:38:11.381ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a96dde67-43c1-4734-a9ba-17e6064f74b7", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
58622024-10-01T02:38:11.381ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58632024-10-01T02:38:11.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58642024-10-01T02:38:11.384ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 349.462006ms iteration = 11 status = {}
58652024-10-01T02:38:11.384ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58662024-10-01T02:38:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58672024-10-01T02:38:11.385ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58682024-10-01T02:38:11.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58692024-10-01T02:38:11.387ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58702024-10-01T02:38:11.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58712024-10-01T02:38:11.388ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58722024-10-01T02:38:11.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58732024-10-01T02:38:11.390ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58742024-10-01T02:38:11.393ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
58752024-10-01T02:38:11.393ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58762024-10-01T02:38:11.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58772024-10-01T02:38:11.394ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58782024-10-01T02:38:11.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58792024-10-01T02:38:11.394ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
58802024-10-01T02:38:11.396ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58812024-10-01T02:38:11.396ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e601f0c-c6f2-4f9b-851b-93f8c0ba5a6c", "content-length": "2", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
58822024-10-01T02:38:11.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58832024-10-01T02:38:11.398ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58842024-10-01T02:38:11.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58852024-10-01T02:38:11.400ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 366.38471ms iteration = 11 status = null
58862024-10-01T02:38:11.400ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58872024-10-01T02:38:11.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58882024-10-01T02:38:11.403ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58892024-10-01T02:38:11.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58902024-10-01T02:38:11.405ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
58912024-10-01T02:38:11.405ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
58922024-10-01T02:38:11.405ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-01 02:33:12.369795 UTC dns_group = internal generation = 1
58932024-10-01T02:38:11.405ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 371.660088ms iteration = 6 status = {"generation":1}
58942024-10-01T02:38:11.406ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58952024-10-01T02:38:11.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58962024-10-01T02:38:11.408ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58972024-10-01T02:38:11.409ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58982024-10-01T02:38:11.409ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58992024-10-01T02:38:11.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59002024-10-01T02:38:11.410ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59012024-10-01T02:38:11.412ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59022024-10-01T02:38:11.412ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59032024-10-01T02:38:11.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59042024-10-01T02:38:11.420ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
59052024-10-01T02:38:11.420ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59062024-10-01T02:38:11.421ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9907f9a-646c-4ae7-9a7a-71b471c93022", "content-length": "26", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
59072024-10-01T02:38:11.421ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59082024-10-01T02:38:11.423ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
59092024-10-01T02:38:11.428ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59102024-10-01T02:38:11.431ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
59112024-10-01T02:38:11.431ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59122024-10-01T02:38:11.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59132024-10-01T02:38:11.446ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
59142024-10-01T02:38:11.447ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b7d78324-876e-44e5-81ff-74d8c68b946b", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
59152024-10-01T02:38:11.447ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
59162024-10-01T02:38:11.450ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e92ae4f5-4dc1-4157-bac2-7ea72e239cb5", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
59172024-10-01T02:38:11.450ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
59182024-10-01T02:38:11.450ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59192024-10-01T02:38:11.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59202024-10-01T02:38:11.452ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b4b1f9f3-beb2-4fe9-8715-661653bab8af", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
59212024-10-01T02:38:11.452ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
59222024-10-01T02:38:11.453ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59232024-10-01T02:38:11.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59242024-10-01T02:38:11.459ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
59252024-10-01T02:38:11.459ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 425.048763ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
59262024-10-01T02:38:11.460ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59272024-10-01T02:38:11.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59282024-10-01T02:38:11.463ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59292024-10-01T02:38:11.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59302024-10-01T02:38:11.467ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59312024-10-01T02:38:11.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59322024-10-01T02:38:11.469ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59332024-10-01T02:38:11.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59342024-10-01T02:38:11.471ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59352024-10-01T02:38:11.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59362024-10-01T02:38:11.478ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
59372024-10-01T02:38:11.478ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "dfc495c3-23a2-42b1-9c26-9b9560fa97d0", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59382024-10-01T02:38:11.478ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59392024-10-01T02:38:11.480ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9f425dc2-c151-47f2-9af9-0a15b92696e4", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59402024-10-01T02:38:11.480ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59412024-10-01T02:38:11.482ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59422024-10-01T02:38:11.482ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 447.799254ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
59432024-10-01T02:38:11.508ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59442024-10-01T02:38:11.513ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
59452024-10-01T02:38:11.513ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59462024-10-01T02:38:11.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59472024-10-01T02:38:11.527ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59482024-10-01T02:38:11.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59492024-10-01T02:38:11.551ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59502024-10-01T02:38:11.553ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c39033b-b309-4d43-b17b-0f7bc2487657", "content-length": "691", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
59512024-10-01T02:38:11.553ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
59522024-10-01T02:38:11.553ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
59532024-10-01T02:38:11.553ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
59542024-10-01T02:38:11.555ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59552024-10-01T02:38:11.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59562024-10-01T02:38:11.556ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 521.748102ms iteration = 11 status = {}
59572024-10-01T02:38:11.557ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59582024-10-01T02:38:11.563ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
59592024-10-01T02:38:11.563ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59602024-10-01T02:38:11.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59612024-10-01T02:38:11.579ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 498a9376-2ad6-4307-b191-e6d73cf2f1a4, kind: Service { id: 0a1ed896-5078-4267-b636-10151376f015 }, name: Name("external-dns-0a1ed896-5078-4267-b636-10151376f015"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4ffe935-3383-46e7-947f-e87df509f06f, kind: Service { id: eb937866-c779-4a9e-aec4-cc18302d4ce1 }, name: Name("external-dns-eb937866-c779-4a9e-aec4-cc18302d4ce1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 225])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 611bfb6e-9731-4e0b-9af8-03e07b661aa3, kind: Service { id: 772acfa5-ee20-4a17-a053-c207ffa50ed6 }, name: Name("nexus-772acfa5-ee20-4a17-a053-c207ffa50ed6"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 98b85cfc-ac80-4175-9f04-dd15c9b20d24, kind: Service { id: 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35 }, name: Name("nexus-3dfd7033-71d8-4eb9-bb97-49dae3b5cd35"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 29])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a840a1d8-f258-45fe-96a0-7b8383461d51, kind: Service { id: e9e4c757-e076-4386-92e2-8217b8bb307d }, name: Name("nexus-e9e4c757-e076-4386-92e2-8217b8bb307d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
59622024-10-01T02:38:11.579ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59632024-10-01T02:38:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59642024-10-01T02:38:11.581ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59652024-10-01T02:38:11.583ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
59662024-10-01T02:38:11.583ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59672024-10-01T02:38:11.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59682024-10-01T02:38:11.585ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
59692024-10-01T02:38:11.585ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 498a9376-2ad6-4307-b191-e6d73cf2f1a4, kind: Service { id: 0a1ed896-5078-4267-b636-10151376f015 }, name: Name("external-dns-0a1ed896-5078-4267-b636-10151376f015"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4ffe935-3383-46e7-947f-e87df509f06f, kind: Service { id: eb937866-c779-4a9e-aec4-cc18302d4ce1 }, name: Name("external-dns-eb937866-c779-4a9e-aec4-cc18302d4ce1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 225])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 611bfb6e-9731-4e0b-9af8-03e07b661aa3, kind: Service { id: 772acfa5-ee20-4a17-a053-c207ffa50ed6 }, name: Name("nexus-772acfa5-ee20-4a17-a053-c207ffa50ed6"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 98b85cfc-ac80-4175-9f04-dd15c9b20d24, kind: Service { id: 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35 }, name: Name("nexus-3dfd7033-71d8-4eb9-bb97-49dae3b5cd35"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 29])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a840a1d8-f258-45fe-96a0-7b8383461d51, kind: Service { id: e9e4c757-e076-4386-92e2-8217b8bb307d }, name: Name("nexus-e9e4c757-e076-4386-92e2-8217b8bb307d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
59702024-10-01T02:38:11.586ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
59712024-10-01T02:38:11.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59722024-10-01T02:38:11.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59732024-10-01T02:38:11.611ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
59742024-10-01T02:38:11.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59752024-10-01T02:38:11.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59762024-10-01T02:38:11.623ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
59772024-10-01T02:38:11.624ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2f20a3a-dc33-4799-8753-8acf6a2723d8", "content-length": "121", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
59782024-10-01T02:38:11.624ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
59792024-10-01T02:38:11.624ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
59802024-10-01T02:38:11.624ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59812024-10-01T02:38:11.624ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59822024-10-01T02:38:11.624ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
59832024-10-01T02:38:11.624ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
59842024-10-01T02:38:11.624ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
59852024-10-01T02:38:11.624ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59862024-10-01T02:38:11.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59872024-10-01T02:38:11.627ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
59882024-10-01T02:38:11.627ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3aff830-a454-4b4b-bcc2-e384e8d412bb", "content-length": "2", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
59892024-10-01T02:38:11.627ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
59902024-10-01T02:38:11.627ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "79c69746-734c-461c-9170-d1b89cf55db4", "content-length": "52", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
59912024-10-01T02:38:11.627ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
59922024-10-01T02:38:11.627ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
59932024-10-01T02:38:11.725ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 2a571ec0-85a3-450e-88fc-680c13ffa211, time_created: 2024-10-01T02:33:11.506220Z, time_modified: 2024-10-01T02:33:11.506220Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
59942024-10-01T02:38:11.725ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
59952024-10-01T02:38:11.725ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59962024-10-01T02:38:11.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59972024-10-01T02:38:11.727ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59982024-10-01T02:38:11.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59992024-10-01T02:38:11.728ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60002024-10-01T02:38:11.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
60012024-10-01T02:38:11.758ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "72dc2361-972b-4be2-8a30-c555bd7923c5", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
60022024-10-01T02:38:11.758ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
60032024-10-01T02:38:11.758ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60042024-10-01T02:38:11.763ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cf4a8ca-f3e4-4794-9f8f-f6c0d2dd7872", "content-length": "667", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
60052024-10-01T02:38:11.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60062024-10-01T02:38:11.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60072024-10-01T02:38:11.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60082024-10-01T02:38:11.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60092024-10-01T02:38:11.768ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 390 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 957e09c7-821b-4fae-99c0-00c38aa6d4db response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
60102024-10-01T02:38:11.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60112024-10-01T02:38:11.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60122024-10-01T02:38:11.775ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60132024-10-01T02:38:11.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60142024-10-01T02:38:11.777ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
60152024-10-01T02:38:11.778ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "2aca0bc6-0001-43e0-897b-4cb315dc92a8", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
60162024-10-01T02:38:11.780ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
60172024-10-01T02:38:11.780ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 745.619364ms
60182024-10-01T02:38:11.780ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 745.674225ms iteration = 2 status = {}
60192024-10-01T02:38:11.782ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 747.854062ms iteration = 11 status = {}
60202024-10-01T02:38:12.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 304496a5-37e0-4440-9fe3-2e2252e377ee roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60212024-10-01T02:38:12.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 304496a5-37e0-4440-9fe3-2e2252e377ee resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60222024-10-01T02:38:12.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 304496a5-37e0-4440-9fe3-2e2252e377ee response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60232024-10-01T02:38:13.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7db20b63-2b21-4b9b-b22a-e9d81b91b5de roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60242024-10-01T02:38:13.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7db20b63-2b21-4b9b-b22a-e9d81b91b5de resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60252024-10-01T02:38:13.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7db20b63-2b21-4b9b-b22a-e9d81b91b5de response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60262024-10-01T02:38:14.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d068aa3a-e0ec-4a31-b04e-3fa2b537f311 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60272024-10-01T02:38:14.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d068aa3a-e0ec-4a31-b04e-3fa2b537f311 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60282024-10-01T02:38:14.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2737 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d068aa3a-e0ec-4a31-b04e-3fa2b537f311 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60292024-10-01T02:38:15.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 70ca7819-50bb-40bf-93b9-2d86ae9215a6 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60302024-10-01T02:38:15.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 70ca7819-50bb-40bf-93b9-2d86ae9215a6 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60312024-10-01T02:38:15.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2613 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 70ca7819-50bb-40bf-93b9-2d86ae9215a6 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60322024-10-01T02:38:16.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a386fa86-6d5d-4993-b7ad-580fb0dc0f04 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60332024-10-01T02:38:16.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a386fa86-6d5d-4993-b7ad-580fb0dc0f04 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60342024-10-01T02:38:16.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a386fa86-6d5d-4993-b7ad-580fb0dc0f04 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60352024-10-01T02:38:17.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 463e26ef-b474-46bf-b83b-cde3bd583566 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60362024-10-01T02:38:17.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 463e26ef-b474-46bf-b83b-cde3bd583566 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60372024-10-01T02:38:17.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 463e26ef-b474-46bf-b83b-cde3bd583566 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60382024-10-01T02:38:18.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6db8e21d-39e5-46bd-9bd2-6b6eedabf795 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60392024-10-01T02:38:18.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6db8e21d-39e5-46bd-9bd2-6b6eedabf795 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60402024-10-01T02:38:18.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1846 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6db8e21d-39e5-46bd-9bd2-6b6eedabf795 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60412024-10-01T02:38:19.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 229089ad-1ee4-43a5-9d65-51d879522cea roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60422024-10-01T02:38:19.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 229089ad-1ee4-43a5-9d65-51d879522cea resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60432024-10-01T02:38:19.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2552 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 229089ad-1ee4-43a5-9d65-51d879522cea response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60442024-10-01T02:38:20.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a939bfa1-8ae5-4a24-9ece-36695e4969fd roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60452024-10-01T02:38:20.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a939bfa1-8ae5-4a24-9ece-36695e4969fd resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60462024-10-01T02:38:20.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a939bfa1-8ae5-4a24-9ece-36695e4969fd response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60472024-10-01T02:38:21.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
60482024-10-01T02:38:21.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60492024-10-01T02:38:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60502024-10-01T02:38:21.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
60512024-10-01T02:38:21.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60522024-10-01T02:38:21.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60532024-10-01T02:38:21.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60542024-10-01T02:38:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60552024-10-01T02:38:21.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60562024-10-01T02:38:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60572024-10-01T02:38:21.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60582024-10-01T02:38:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60592024-10-01T02:38:21.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60602024-10-01T02:38:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
60612024-10-01T02:38:21.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60622024-10-01T02:38:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60632024-10-01T02:38:21.051ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
60642024-10-01T02:38:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.91286ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
60652024-10-01T02:38:21.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60662024-10-01T02:38:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60672024-10-01T02:38:21.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.125537ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60682024-10-01T02:38:21.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a976d452-a731-4df8-9869-cb9774c06cf4 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60692024-10-01T02:38:21.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a976d452-a731-4df8-9869-cb9774c06cf4 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60702024-10-01T02:38:21.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a976d452-a731-4df8-9869-cb9774c06cf4 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60712024-10-01T02:38:21.769ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 572 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 26afbfc3-e1df-407e-8851-e9034c2cda29 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
60722024-10-01T02:38:22.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a64787fd-d484-413b-92af-b7dfd37fb352 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60732024-10-01T02:38:22.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a64787fd-d484-413b-92af-b7dfd37fb352 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60742024-10-01T02:38:22.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a64787fd-d484-413b-92af-b7dfd37fb352 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60752024-10-01T02:38:23.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 60d4bfbe-bbab-4fb4-82dc-2c2796d3a683 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60762024-10-01T02:38:23.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 60d4bfbe-bbab-4fb4-82dc-2c2796d3a683 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60772024-10-01T02:38:23.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 60d4bfbe-bbab-4fb4-82dc-2c2796d3a683 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60782024-10-01T02:38:24.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a07a7787-16af-4ccf-b46d-00b39b97b333 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60792024-10-01T02:38:24.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a07a7787-16af-4ccf-b46d-00b39b97b333 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60802024-10-01T02:38:24.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a07a7787-16af-4ccf-b46d-00b39b97b333 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60812024-10-01T02:38:25.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1fcb5ac9-4a74-4f15-8f81-d5387de0c993 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60822024-10-01T02:38:25.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1fcb5ac9-4a74-4f15-8f81-d5387de0c993 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60832024-10-01T02:38:25.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1fcb5ac9-4a74-4f15-8f81-d5387de0c993 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60842024-10-01T02:38:26.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3853f5a5-daaa-45b0-96a0-6823f1ad5c83 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60852024-10-01T02:38:26.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3853f5a5-daaa-45b0-96a0-6823f1ad5c83 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60862024-10-01T02:38:26.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3853f5a5-daaa-45b0-96a0-6823f1ad5c83 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60872024-10-01T02:38:27.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5f326977-728d-4d70-9a98-68624dd898f3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60882024-10-01T02:38:27.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5f326977-728d-4d70-9a98-68624dd898f3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60892024-10-01T02:38:27.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5f326977-728d-4d70-9a98-68624dd898f3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60902024-10-01T02:38:28.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3f7f5a7f-57bf-4e05-b8a7-9ad9ed742502 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60912024-10-01T02:38:28.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3f7f5a7f-57bf-4e05-b8a7-9ad9ed742502 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60922024-10-01T02:38:28.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3f7f5a7f-57bf-4e05-b8a7-9ad9ed742502 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60932024-10-01T02:38:29.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e61cd061-4dd8-4e78-b71d-fffa844d79ac roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60942024-10-01T02:38:29.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e61cd061-4dd8-4e78-b71d-fffa844d79ac resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60952024-10-01T02:38:29.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2802 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e61cd061-4dd8-4e78-b71d-fffa844d79ac response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60962024-10-01T02:38:30.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ca3b06f4-920e-4873-beef-6cd0e928f462 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60972024-10-01T02:38:30.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ca3b06f4-920e-4873-beef-6cd0e928f462 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60982024-10-01T02:38:30.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ca3b06f4-920e-4873-beef-6cd0e928f462 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
60992024-10-01T02:38:31.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
61002024-10-01T02:38:31.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61012024-10-01T02:38:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61022024-10-01T02:38:31.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
61032024-10-01T02:38:31.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61042024-10-01T02:38:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61052024-10-01T02:38:31.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61062024-10-01T02:38:31.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61072024-10-01T02:38:31.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61082024-10-01T02:38:31.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61092024-10-01T02:38:31.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61102024-10-01T02:38:31.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61112024-10-01T02:38:31.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61122024-10-01T02:38:31.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
61132024-10-01T02:38:31.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61142024-10-01T02:38:31.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61152024-10-01T02:38:31.052ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
61162024-10-01T02:38:31.052ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.5133ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
61172024-10-01T02:38:31.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61182024-10-01T02:38:31.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61192024-10-01T02:38:31.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.686711ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61202024-10-01T02:38:31.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e2cfc315-44aa-48a0-b32a-2a76e1036a8e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61212024-10-01T02:38:31.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e2cfc315-44aa-48a0-b32a-2a76e1036a8e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61222024-10-01T02:38:31.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e2cfc315-44aa-48a0-b32a-2a76e1036a8e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61232024-10-01T02:38:31.768ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 437 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = f4d296ef-5258-42d0-ac07-57ad8df0f652 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
61242024-10-01T02:38:32.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b71f665c-9b05-4e38-bccd-2c0c21d82d29 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61252024-10-01T02:38:32.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b71f665c-9b05-4e38-bccd-2c0c21d82d29 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61262024-10-01T02:38:32.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b71f665c-9b05-4e38-bccd-2c0c21d82d29 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61272024-10-01T02:38:33.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f2b14ee5-794e-4af9-a35b-4f32cfe0a75e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61282024-10-01T02:38:33.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f2b14ee5-794e-4af9-a35b-4f32cfe0a75e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61292024-10-01T02:38:33.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f2b14ee5-794e-4af9-a35b-4f32cfe0a75e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61302024-10-01T02:38:34.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 37b936a0-6d0b-4967-b9c3-59a9ae3d56f4 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61312024-10-01T02:38:34.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 37b936a0-6d0b-4967-b9c3-59a9ae3d56f4 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61322024-10-01T02:38:34.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 37b936a0-6d0b-4967-b9c3-59a9ae3d56f4 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61332024-10-01T02:38:35.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a4cbe5d0-cbe2-42f5-bcd7-5592a1ef8870 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61342024-10-01T02:38:35.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a4cbe5d0-cbe2-42f5-bcd7-5592a1ef8870 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61352024-10-01T02:38:35.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2850 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a4cbe5d0-cbe2-42f5-bcd7-5592a1ef8870 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61362024-10-01T02:38:36.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1081149f-bcfb-4291-99f6-c933844908f2 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61372024-10-01T02:38:36.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1081149f-bcfb-4291-99f6-c933844908f2 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61382024-10-01T02:38:36.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1081149f-bcfb-4291-99f6-c933844908f2 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61392024-10-01T02:38:37.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1251048b-bf70-4bfa-b04a-27b85098dff9 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61402024-10-01T02:38:37.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1251048b-bf70-4bfa-b04a-27b85098dff9 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61412024-10-01T02:38:37.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1251048b-bf70-4bfa-b04a-27b85098dff9 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61422024-10-01T02:38:38.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dc3c5e21-e8ef-4ce3-af5d-97112d4b783e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61432024-10-01T02:38:38.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dc3c5e21-e8ef-4ce3-af5d-97112d4b783e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61442024-10-01T02:38:38.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dc3c5e21-e8ef-4ce3-af5d-97112d4b783e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61452024-10-01T02:38:39.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8c79083c-256b-482e-a533-4f9c9315cb83 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61462024-10-01T02:38:39.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8c79083c-256b-482e-a533-4f9c9315cb83 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61472024-10-01T02:38:39.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8c79083c-256b-482e-a533-4f9c9315cb83 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61482024-10-01T02:38:40.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c4883c1b-0396-4d30-bc8c-7d18f2fbde8b roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61492024-10-01T02:38:40.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c4883c1b-0396-4d30-bc8c-7d18f2fbde8b resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61502024-10-01T02:38:40.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c4883c1b-0396-4d30-bc8c-7d18f2fbde8b response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
61512024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
61522024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
61532024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61542024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
61552024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61562024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
61572024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61582024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61592024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61602024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
61612024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
61622024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
61632024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61642024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61652024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61662024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61672024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
61682024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
61692024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61702024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
61712024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61722024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61732024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
61742024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
61752024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
61762024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61772024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61782024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
61792024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
61802024-10-01T02:38:41.034ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
61812024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
61822024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61832024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61842024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
61852024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61862024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
61872024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61882024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61892024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61902024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
61912024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61922024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61932024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61942024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61952024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61962024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
61972024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61982024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61992024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62002024-10-01T02:38:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62012024-10-01T02:38:41.037ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1574, tv_nsec: 477888404 } })
62022024-10-01T02:38:41.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62032024-10-01T02:38:41.037ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1574, tv_nsec: 478170749 } })
62042024-10-01T02:38:41.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62052024-10-01T02:38:41.037ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.801614ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62062024-10-01T02:38:41.038ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
62072024-10-01T02:38:41.038ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
62082024-10-01T02:38:41.039ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62092024-10-01T02:38:41.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62102024-10-01T02:38:41.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62112024-10-01T02:38:41.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62122024-10-01T02:38:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62132024-10-01T02:38:41.041ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62142024-10-01T02:38:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62152024-10-01T02:38:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62162024-10-01T02:38:41.041ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62172024-10-01T02:38:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62182024-10-01T02:38:41.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62192024-10-01T02:38:41.045ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62202024-10-01T02:38:41.047ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62212024-10-01T02:38:41.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62222024-10-01T02:38:41.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62232024-10-01T02:38:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62242024-10-01T02:38:41.048ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62252024-10-01T02:38:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62262024-10-01T02:38:41.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62272024-10-01T02:38:41.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62282024-10-01T02:38:41.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62292024-10-01T02:38:41.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62302024-10-01T02:38:41.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62312024-10-01T02:38:41.052ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62322024-10-01T02:38:41.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62332024-10-01T02:38:41.052ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62342024-10-01T02:38:41.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62352024-10-01T02:38:41.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62362024-10-01T02:38:41.056ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62372024-10-01T02:38:41.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62382024-10-01T02:38:41.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62392024-10-01T02:38:41.084ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.958967ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
62402024-10-01T02:38:41.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62412024-10-01T02:38:41.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.546543ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
62422024-10-01T02:38:41.089ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
62432024-10-01T02:38:41.089ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 55.007842ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
62442024-10-01T02:38:41.092ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62452024-10-01T02:38:41.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62462024-10-01T02:38:41.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62472024-10-01T02:38:41.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62482024-10-01T02:38:41.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62492024-10-01T02:38:41.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62502024-10-01T02:38:41.102ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62512024-10-01T02:38:41.102ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
62522024-10-01T02:38:41.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62532024-10-01T02:38:41.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62542024-10-01T02:38:41.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62552024-10-01T02:38:41.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62562024-10-01T02:38:41.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62572024-10-01T02:38:41.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62582024-10-01T02:38:41.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62592024-10-01T02:38:41.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62602024-10-01T02:38:41.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62612024-10-01T02:38:41.104ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62622024-10-01T02:38:41.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62632024-10-01T02:38:41.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62642024-10-01T02:38:41.104ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62652024-10-01T02:38:41.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62662024-10-01T02:38:41.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62672024-10-01T02:38:41.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62682024-10-01T02:38:41.107ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62692024-10-01T02:38:41.107ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62702024-10-01T02:38:41.107ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62712024-10-01T02:38:41.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62722024-10-01T02:38:41.109ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1574, tv_nsec: 550248597 } })
62732024-10-01T02:38:41.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
62742024-10-01T02:38:41.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62752024-10-01T02:38:41.109ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
62762024-10-01T02:38:41.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62772024-10-01T02:38:41.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
62782024-10-01T02:38:41.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62792024-10-01T02:38:41.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62802024-10-01T02:38:41.113ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 78.378193ms iteration = 12 status = 0
62812024-10-01T02:38:41.116ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
62822024-10-01T02:38:41.116ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62832024-10-01T02:38:41.116ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f18651d7-3869-4ec5-a9aa-d9cada4f8f8a", "content-length": "26", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
62842024-10-01T02:38:41.116ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62852024-10-01T02:38:41.119ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62862024-10-01T02:38:41.123ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
62872024-10-01T02:38:41.123ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.446098ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
62882024-10-01T02:38:41.133ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
62892024-10-01T02:38:41.133ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62902024-10-01T02:38:41.133ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d409aa6-dada-48c4-a84a-75c3f5bc622c", "content-length": "26", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
62912024-10-01T02:38:41.133ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62922024-10-01T02:38:41.135ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62932024-10-01T02:38:41.137ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 102.337755ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62942024-10-01T02:38:41.147ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62952024-10-01T02:38:41.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62962024-10-01T02:38:41.148ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 113.236668ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62972024-10-01T02:38:41.158ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62982024-10-01T02:38:41.158ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
62992024-10-01T02:38:41.158ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.908787ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63002024-10-01T02:38:41.159ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 124.524927ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
63012024-10-01T02:38:41.191ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 157.226385ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
63022024-10-01T02:38:41.195ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63032024-10-01T02:38:41.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63042024-10-01T02:38:41.208ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
63052024-10-01T02:38:41.208ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63062024-10-01T02:38:41.209ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7201e45-8c48-43d1-8051-af1267598a84", "content-length": "26", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
63072024-10-01T02:38:41.209ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63082024-10-01T02:38:41.211ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
63092024-10-01T02:38:41.219ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63102024-10-01T02:38:41.219ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e993eab0-769a-4267-b95b-0ea55aa5b95c", "content-length": "2", "date": "Tue, 01 Oct 2024 02:38:40 GMT"} })
63112024-10-01T02:38:41.221ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63122024-10-01T02:38:41.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63132024-10-01T02:38:41.236ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 202.217289ms iteration = 12 status = {}
63142024-10-01T02:38:41.237ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 202.565254ms iteration = 14 status = {"physical_disks_added":0}
63152024-10-01T02:38:41.242ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63162024-10-01T02:38:41.243ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a63faeed-486b-4ae9-8831-35f1c8cd2c08", "content-length": "372", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
63172024-10-01T02:38:41.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63182024-10-01T02:38:41.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63192024-10-01T02:38:41.244ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63202024-10-01T02:38:41.245ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 210.946235ms iteration = 12 status = null
63212024-10-01T02:38:41.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63222024-10-01T02:38:41.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63232024-10-01T02:38:41.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63242024-10-01T02:38:41.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63252024-10-01T02:38:41.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63262024-10-01T02:38:41.247ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63272024-10-01T02:38:41.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63282024-10-01T02:38:41.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63292024-10-01T02:38:41.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63302024-10-01T02:38:41.248ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63312024-10-01T02:38:41.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63322024-10-01T02:38:41.251ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63332024-10-01T02:38:41.251ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1bd60b4a-53c8-4868-af3b-a6f3f2b54974", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
63342024-10-01T02:38:41.253ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 218.227467ms iteration = 12 status = {}
63352024-10-01T02:38:41.311ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63362024-10-01T02:38:41.312ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "288e10e6-cc0a-4962-a88d-d37c3ceae58d", "content-length": "691", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
63372024-10-01T02:38:41.312ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
63382024-10-01T02:38:41.312ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
63392024-10-01T02:38:41.312ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
63402024-10-01T02:38:41.314ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 279.513504ms iteration = 12 status = {}
63412024-10-01T02:38:41.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63422024-10-01T02:38:41.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63432024-10-01T02:38:41.356ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
63442024-10-01T02:38:41.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63452024-10-01T02:38:41.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63462024-10-01T02:38:41.364ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63472024-10-01T02:38:41.365ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0301313-5290-484e-a043-b47a5e4b2e02", "content-length": "121", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
63482024-10-01T02:38:41.365ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
63492024-10-01T02:38:41.365ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
63502024-10-01T02:38:41.365ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63512024-10-01T02:38:41.365ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63522024-10-01T02:38:41.365ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
63532024-10-01T02:38:41.365ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
63542024-10-01T02:38:41.365ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
63552024-10-01T02:38:41.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63562024-10-01T02:38:41.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63572024-10-01T02:38:41.366ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63582024-10-01T02:38:41.366ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "218207be-846d-4951-8b39-17af32f5027b", "content-length": "2", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
63592024-10-01T02:38:41.366ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63602024-10-01T02:38:41.367ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5254e87-ecf1-4d4e-b59d-56cd4a8d27e2", "content-length": "52", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
63612024-10-01T02:38:41.367ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
63622024-10-01T02:38:41.367ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63632024-10-01T02:38:41.462ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "de4d7c5e-35e3-40e4-8d25-bdbdeae97bca", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
63642024-10-01T02:38:41.462ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
63652024-10-01T02:38:41.462ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63662024-10-01T02:38:41.466ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "97e426e0-1e26-4443-9001-6b7d99b06ed9", "content-length": "667", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
63672024-10-01T02:38:41.466ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63682024-10-01T02:38:41.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63692024-10-01T02:38:41.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63702024-10-01T02:38:41.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63712024-10-01T02:38:41.473ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63722024-10-01T02:38:41.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63732024-10-01T02:38:41.475ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63742024-10-01T02:38:41.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63752024-10-01T02:38:41.483ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 448.319332ms iteration = 12 status = {}
63762024-10-01T02:38:41.768ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 451 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 82176e0f-82d0-4e9d-ba88-92938dff7266 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
63772024-10-01T02:38:41.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3186b9ab-d3cc-412c-897b-55d2ca231ed6 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63782024-10-01T02:38:41.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3186b9ab-d3cc-412c-897b-55d2ca231ed6 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63792024-10-01T02:38:41.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3186b9ab-d3cc-412c-897b-55d2ca231ed6 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63802024-10-01T02:38:42.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ad2e2931-eedc-478e-afd3-2441ffe00809 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63812024-10-01T02:38:42.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ad2e2931-eedc-478e-afd3-2441ffe00809 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63822024-10-01T02:38:42.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ad2e2931-eedc-478e-afd3-2441ffe00809 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63832024-10-01T02:38:43.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 20fa35c5-224f-4bca-a062-5201723966c3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63842024-10-01T02:38:43.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 20fa35c5-224f-4bca-a062-5201723966c3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63852024-10-01T02:38:43.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 20fa35c5-224f-4bca-a062-5201723966c3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63862024-10-01T02:38:44.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1bc55419-0bbe-43a5-a7e9-9d2b059b5802 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63872024-10-01T02:38:44.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1bc55419-0bbe-43a5-a7e9-9d2b059b5802 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63882024-10-01T02:38:44.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1927 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1bc55419-0bbe-43a5-a7e9-9d2b059b5802 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63892024-10-01T02:38:45.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c63ec656-eea9-4958-9145-a455824e4f01 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63902024-10-01T02:38:45.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c63ec656-eea9-4958-9145-a455824e4f01 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63912024-10-01T02:38:45.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2890 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c63ec656-eea9-4958-9145-a455824e4f01 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63922024-10-01T02:38:46.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e339d64a-3b40-48e8-a28c-c3cce3ef6376 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63932024-10-01T02:38:46.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e339d64a-3b40-48e8-a28c-c3cce3ef6376 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63942024-10-01T02:38:46.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e339d64a-3b40-48e8-a28c-c3cce3ef6376 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63952024-10-01T02:38:47.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 53f6c539-687b-4166-8a9a-9e309e2fafe3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63962024-10-01T02:38:47.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 53f6c539-687b-4166-8a9a-9e309e2fafe3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63972024-10-01T02:38:47.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 53f6c539-687b-4166-8a9a-9e309e2fafe3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63982024-10-01T02:38:48.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1cbeaa89-315d-4de2-afe3-1dd0d25b08cf roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
63992024-10-01T02:38:48.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1cbeaa89-315d-4de2-afe3-1dd0d25b08cf resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64002024-10-01T02:38:48.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1cbeaa89-315d-4de2-afe3-1dd0d25b08cf response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64012024-10-01T02:38:50.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d9d1b469-b573-45e2-b77c-2bfec3f09060 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64022024-10-01T02:38:50.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d9d1b469-b573-45e2-b77c-2bfec3f09060 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64032024-10-01T02:38:50.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d9d1b469-b573-45e2-b77c-2bfec3f09060 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64042024-10-01T02:38:51.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cf832f71-53e7-4bdb-81ba-6fc10b0dcb7e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64052024-10-01T02:38:51.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cf832f71-53e7-4bdb-81ba-6fc10b0dcb7e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64062024-10-01T02:38:51.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2689 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cf832f71-53e7-4bdb-81ba-6fc10b0dcb7e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64072024-10-01T02:38:51.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
64082024-10-01T02:38:51.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64092024-10-01T02:38:51.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64102024-10-01T02:38:51.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
64112024-10-01T02:38:51.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64122024-10-01T02:38:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64132024-10-01T02:38:51.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64142024-10-01T02:38:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64152024-10-01T02:38:51.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64162024-10-01T02:38:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64172024-10-01T02:38:51.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64182024-10-01T02:38:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64192024-10-01T02:38:51.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64202024-10-01T02:38:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
64212024-10-01T02:38:51.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64222024-10-01T02:38:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64232024-10-01T02:38:51.057ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
64242024-10-01T02:38:51.057ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.742978ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
64252024-10-01T02:38:51.063ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64262024-10-01T02:38:51.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64272024-10-01T02:38:51.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.814116ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64282024-10-01T02:38:51.768ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 622 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = a09c0a8f-3e25-4a55-8c68-9d7b6e820a27 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
64292024-10-01T02:38:52.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5bd37f9d-c1e9-4acc-b1bb-868303239400 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64302024-10-01T02:38:52.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5bd37f9d-c1e9-4acc-b1bb-868303239400 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64312024-10-01T02:38:52.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5bd37f9d-c1e9-4acc-b1bb-868303239400 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64322024-10-01T02:38:53.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4304e581-4e38-47d1-a60e-c198785f1ae8 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64332024-10-01T02:38:53.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4304e581-4e38-47d1-a60e-c198785f1ae8 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64342024-10-01T02:38:53.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4304e581-4e38-47d1-a60e-c198785f1ae8 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64352024-10-01T02:38:54.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a704b7f5-c982-4ef6-bb4f-0e65daabde53 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64362024-10-01T02:38:54.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a704b7f5-c982-4ef6-bb4f-0e65daabde53 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64372024-10-01T02:38:54.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2557 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a704b7f5-c982-4ef6-bb4f-0e65daabde53 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64382024-10-01T02:38:55.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c451ff02-0ce8-4085-b741-c3a8d260ee54 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64392024-10-01T02:38:55.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c451ff02-0ce8-4085-b741-c3a8d260ee54 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64402024-10-01T02:38:55.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c451ff02-0ce8-4085-b741-c3a8d260ee54 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64412024-10-01T02:38:56.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1982dd95-9a0c-451c-b3b7-1710ad77d724 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64422024-10-01T02:38:56.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1982dd95-9a0c-451c-b3b7-1710ad77d724 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64432024-10-01T02:38:56.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1982dd95-9a0c-451c-b3b7-1710ad77d724 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64442024-10-01T02:38:57.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 97186a6a-9836-4099-b446-9ded6e040299 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64452024-10-01T02:38:57.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 97186a6a-9836-4099-b446-9ded6e040299 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64462024-10-01T02:38:57.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 97186a6a-9836-4099-b446-9ded6e040299 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64472024-10-01T02:38:58.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3eccef59-b0c3-424d-831f-9f041865d808 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64482024-10-01T02:38:58.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3eccef59-b0c3-424d-831f-9f041865d808 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64492024-10-01T02:38:58.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3eccef59-b0c3-424d-831f-9f041865d808 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64502024-10-01T02:38:59.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8b590e42-075d-43ca-b228-088e7b456877 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64512024-10-01T02:38:59.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8b590e42-075d-43ca-b228-088e7b456877 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64522024-10-01T02:38:59.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8b590e42-075d-43ca-b228-088e7b456877 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64532024-10-01T02:39:00.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6331e380-2468-4e07-99e3-ddb89ead150f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64542024-10-01T02:39:00.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6331e380-2468-4e07-99e3-ddb89ead150f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64552024-10-01T02:39:00.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6331e380-2468-4e07-99e3-ddb89ead150f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64562024-10-01T02:39:01.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
64572024-10-01T02:39:01.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64582024-10-01T02:39:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64592024-10-01T02:39:01.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
64602024-10-01T02:39:01.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64612024-10-01T02:39:01.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64622024-10-01T02:39:01.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64632024-10-01T02:39:01.036ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64642024-10-01T02:39:01.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64652024-10-01T02:39:01.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64662024-10-01T02:39:01.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64672024-10-01T02:39:01.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64682024-10-01T02:39:01.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64692024-10-01T02:39:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64702024-10-01T02:39:01.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64712024-10-01T02:39:01.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
64722024-10-01T02:39:01.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64732024-10-01T02:39:01.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64742024-10-01T02:39:01.055ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
64752024-10-01T02:39:01.055ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.46339ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
64762024-10-01T02:39:01.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.777272ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64772024-10-01T02:39:01.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f4085fc3-e487-4568-98d8-2da31446a9e2 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64782024-10-01T02:39:01.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f4085fc3-e487-4568-98d8-2da31446a9e2 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64792024-10-01T02:39:01.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f4085fc3-e487-4568-98d8-2da31446a9e2 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64802024-10-01T02:39:01.768ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 407 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = c8bf8dd3-9f4b-484f-b9f4-7dad872e3fe4 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
64812024-10-01T02:39:02.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fd4967f1-b71b-4d0e-b7e1-bf1d11772550 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64822024-10-01T02:39:02.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fd4967f1-b71b-4d0e-b7e1-bf1d11772550 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64832024-10-01T02:39:02.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fd4967f1-b71b-4d0e-b7e1-bf1d11772550 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64842024-10-01T02:39:03.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fb514ad9-0632-469a-a3a1-7437e71d2b23 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64852024-10-01T02:39:03.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fb514ad9-0632-469a-a3a1-7437e71d2b23 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64862024-10-01T02:39:03.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2705 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fb514ad9-0632-469a-a3a1-7437e71d2b23 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64872024-10-01T02:39:04.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0c3fefbd-a31b-495d-9857-f22f298a9db7 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64882024-10-01T02:39:04.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0c3fefbd-a31b-495d-9857-f22f298a9db7 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64892024-10-01T02:39:04.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0c3fefbd-a31b-495d-9857-f22f298a9db7 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64902024-10-01T02:39:05.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = eec6230b-8769-446f-970e-e1d9c15e5304 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64912024-10-01T02:39:05.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = eec6230b-8769-446f-970e-e1d9c15e5304 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64922024-10-01T02:39:05.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = eec6230b-8769-446f-970e-e1d9c15e5304 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64932024-10-01T02:39:06.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3cfe8f32-bdde-4994-8158-0627568a5558 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64942024-10-01T02:39:06.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3cfe8f32-bdde-4994-8158-0627568a5558 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64952024-10-01T02:39:06.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3cfe8f32-bdde-4994-8158-0627568a5558 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64962024-10-01T02:39:07.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4597399e-559b-4387-9e9d-1c60a3f6d490 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64972024-10-01T02:39:07.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4597399e-559b-4387-9e9d-1c60a3f6d490 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64982024-10-01T02:39:07.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 4597399e-559b-4387-9e9d-1c60a3f6d490 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
64992024-10-01T02:39:08.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 88294f2b-7f50-46f4-8975-c4224dd9ced5 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
65002024-10-01T02:39:08.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 88294f2b-7f50-46f4-8975-c4224dd9ced5 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
65012024-10-01T02:39:08.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 88294f2b-7f50-46f4-8975-c4224dd9ced5 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
65022024-10-01T02:39:09.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 702a6b26-118d-437b-9914-53f4eaf07bcb roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
65032024-10-01T02:39:09.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 702a6b26-118d-437b-9914-53f4eaf07bcb resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
65042024-10-01T02:39:09.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2750 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 702a6b26-118d-437b-9914-53f4eaf07bcb response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
65052024-10-01T02:39:10.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0da282c7-d149-4776-a070-ebff2c1d330b roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
65062024-10-01T02:39:10.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0da282c7-d149-4776-a070-ebff2c1d330b resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
65072024-10-01T02:39:10.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0da282c7-d149-4776-a070-ebff2c1d330b response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
65082024-10-01T02:39:11.033ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
65092024-10-01T02:39:11.033ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
65102024-10-01T02:39:11.033ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65112024-10-01T02:39:11.033ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
65122024-10-01T02:39:11.033ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
65132024-10-01T02:39:11.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65142024-10-01T02:39:11.033ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
65152024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65162024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
65172024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
65182024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
65192024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
65202024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
65212024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
65222024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
65232024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65242024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
65252024-10-01T02:39:11.034ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07
65262024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
65272024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.88\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07"}
65282024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
65292024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65302024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
65312024-10-01T02:39:11.034ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-01 02:29:11.034093365 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
65322024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
65332024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65342024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65352024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65362024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65372024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65382024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65392024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
65402024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65412024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
65422024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
65432024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
65442024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
65452024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65462024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65472024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
65482024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65492024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
65502024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
65512024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
65522024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65532024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
65542024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65552024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
65562024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65572024-10-01T02:39:11.034ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
65582024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65592024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
65602024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65612024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
65622024-10-01T02:39:11.035ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
65632024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
65642024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
65652024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
65662024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65672024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
65682024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65692024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65702024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
65712024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65722024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
65732024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
65742024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
65752024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
65762024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
65772024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65782024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65792024-10-01T02:39:11.035ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 475655527 } })
65802024-10-01T02:39:11.035ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 475669797 } })
65812024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
65822024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
65832024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65842024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65852024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65862024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65872024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65882024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65892024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
65902024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65912024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65922024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65932024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
65942024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65952024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65962024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65972024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65982024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65992024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66002024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66012024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66022024-10-01T02:39:11.035ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66032024-10-01T02:39:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66042024-10-01T02:39:11.036ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66052024-10-01T02:39:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66062024-10-01T02:39:11.036ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
66072024-10-01T02:39:11.036ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.816357ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
66082024-10-01T02:39:11.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66092024-10-01T02:39:11.037ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66102024-10-01T02:39:11.037ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 478225340 } })
66112024-10-01T02:39:11.037ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
66122024-10-01T02:39:11.037ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.855645ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
66132024-10-01T02:39:11.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66142024-10-01T02:39:11.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66152024-10-01T02:39:11.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66162024-10-01T02:39:11.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66172024-10-01T02:39:11.038ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.861171ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
66182024-10-01T02:39:11.038ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
66192024-10-01T02:39:11.039ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 479498351 } })
66202024-10-01T02:39:11.039ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
66212024-10-01T02:39:11.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
66222024-10-01T02:39:11.039ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66232024-10-01T02:39:11.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66242024-10-01T02:39:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66252024-10-01T02:39:11.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66262024-10-01T02:39:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66272024-10-01T02:39:11.042ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-01 02:29:11.034093365 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
66282024-10-01T02:39:11.042ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.787407ms iteration = 7 status = {"expiration":"2024-10-01T02:29:11.034093365Z","pruned":[]}
66292024-10-01T02:39:11.043ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66302024-10-01T02:39:11.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66312024-10-01T02:39:11.045ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66322024-10-01T02:39:11.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66332024-10-01T02:39:11.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66342024-10-01T02:39:11.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
66352024-10-01T02:39:11.046ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66362024-10-01T02:39:11.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66372024-10-01T02:39:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
66382024-10-01T02:39:11.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66392024-10-01T02:39:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66402024-10-01T02:39:11.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66412024-10-01T02:39:11.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66422024-10-01T02:39:11.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66432024-10-01T02:39:11.049ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66442024-10-01T02:39:11.051ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.566548ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
66452024-10-01T02:39:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
66462024-10-01T02:39:11.052ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66472024-10-01T02:39:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66482024-10-01T02:39:11.056ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66492024-10-01T02:39:11.057ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66502024-10-01T02:39:11.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66512024-10-01T02:39:11.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
66522024-10-01T02:39:11.059ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66532024-10-01T02:39:11.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66542024-10-01T02:39:11.059ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66552024-10-01T02:39:11.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
66562024-10-01T02:39:11.062ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66572024-10-01T02:39:11.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66582024-10-01T02:39:11.068ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66592024-10-01T02:39:11.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66602024-10-01T02:39:11.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66612024-10-01T02:39:11.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66622024-10-01T02:39:11.096ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
66632024-10-01T02:39:11.097ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
66642024-10-01T02:39:11.097ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.201032ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
66652024-10-01T02:39:11.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66662024-10-01T02:39:11.107ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 547442650 } })
66672024-10-01T02:39:11.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
66682024-10-01T02:39:11.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66692024-10-01T02:39:11.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66702024-10-01T02:39:11.109ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
66712024-10-01T02:39:11.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66722024-10-01T02:39:11.112ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66732024-10-01T02:39:11.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66742024-10-01T02:39:11.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66752024-10-01T02:39:11.116ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66762024-10-01T02:39:11.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66772024-10-01T02:39:11.118ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66782024-10-01T02:39:11.119ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 84.887763ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
66792024-10-01T02:39:11.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
66802024-10-01T02:39:11.121ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
66812024-10-01T02:39:11.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
66822024-10-01T02:39:11.121ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 86.718794ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
66832024-10-01T02:39:11.123ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66842024-10-01T02:39:11.123ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66852024-10-01T02:39:11.123ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
66862024-10-01T02:39:11.124ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66872024-10-01T02:39:11.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66882024-10-01T02:39:11.125ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66892024-10-01T02:39:11.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66902024-10-01T02:39:11.126ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66912024-10-01T02:39:11.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66922024-10-01T02:39:11.126ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66932024-10-01T02:39:11.126ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66942024-10-01T02:39:11.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66952024-10-01T02:39:11.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66962024-10-01T02:39:11.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66972024-10-01T02:39:11.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
66982024-10-01T02:39:11.129ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66992024-10-01T02:39:11.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67002024-10-01T02:39:11.129ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67012024-10-01T02:39:11.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67022024-10-01T02:39:11.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67032024-10-01T02:39:11.132ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67042024-10-01T02:39:11.132ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67052024-10-01T02:39:11.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67062024-10-01T02:39:11.132ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67072024-10-01T02:39:11.133ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67082024-10-01T02:39:11.133ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 98.840206ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
67092024-10-01T02:39:11.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67102024-10-01T02:39:11.135ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 100.819929ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
67112024-10-01T02:39:11.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67122024-10-01T02:39:11.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67132024-10-01T02:39:11.138ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67142024-10-01T02:39:11.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67152024-10-01T02:39:11.141ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67162024-10-01T02:39:11.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67172024-10-01T02:39:11.143ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67182024-10-01T02:39:11.143ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 108.885925ms iteration = 4 status = {"nsuccess":5}
67192024-10-01T02:39:11.146ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67202024-10-01T02:39:11.146ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67212024-10-01T02:39:11.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67222024-10-01T02:39:11.147ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
67232024-10-01T02:39:11.147ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 112.269681ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
67242024-10-01T02:39:11.159ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
67252024-10-01T02:39:11.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
67262024-10-01T02:39:11.164ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67272024-10-01T02:39:11.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67282024-10-01T02:39:11.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67292024-10-01T02:39:11.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 139.706631ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67302024-10-01T02:39:11.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
67312024-10-01T02:39:11.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67322024-10-01T02:39:11.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67332024-10-01T02:39:11.176ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67342024-10-01T02:39:11.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67352024-10-01T02:39:11.180ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 145.803693ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67362024-10-01T02:39:11.182ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
67372024-10-01T02:39:11.182ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
67382024-10-01T02:39:11.182ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
67392024-10-01T02:39:11.182ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67402024-10-01T02:39:11.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67412024-10-01T02:39:11.183ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67422024-10-01T02:39:11.184ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67432024-10-01T02:39:11.184ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
67442024-10-01T02:39:11.184ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
67452024-10-01T02:39:11.184ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 149.77347ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
67462024-10-01T02:39:11.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
67472024-10-01T02:39:11.187ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67482024-10-01T02:39:11.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67492024-10-01T02:39:11.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67502024-10-01T02:39:11.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67512024-10-01T02:39:11.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67522024-10-01T02:39:11.189ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67532024-10-01T02:39:11.189ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
67542024-10-01T02:39:11.189ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67552024-10-01T02:39:11.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67562024-10-01T02:39:11.193ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 158.976954ms iteration = 13 status = 0
67572024-10-01T02:39:11.201ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
67582024-10-01T02:39:11.201ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
67592024-10-01T02:39:11.201ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
67602024-10-01T02:39:11.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67612024-10-01T02:39:11.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67622024-10-01T02:39:11.203ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
67632024-10-01T02:39:11.203ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 170.02372ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
67642024-10-01T02:39:11.205ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67652024-10-01T02:39:11.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67662024-10-01T02:39:11.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67672024-10-01T02:39:11.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67682024-10-01T02:39:11.208ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67692024-10-01T02:39:11.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67702024-10-01T02:39:11.208ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
67712024-10-01T02:39:11.208ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67722024-10-01T02:39:11.210ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "29f50e45-47be-4cc2-802d-d8c3cfc60754", "content-length": "26", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
67732024-10-01T02:39:11.210ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67742024-10-01T02:39:11.211ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
67752024-10-01T02:39:11.211ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 0 version = 2
67762024-10-01T02:39:11.211ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67772024-10-01T02:39:11.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67782024-10-01T02:39:11.212ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67792024-10-01T02:39:11.213ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67802024-10-01T02:39:11.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67812024-10-01T02:39:11.216ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67822024-10-01T02:39:11.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67832024-10-01T02:39:11.230ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67842024-10-01T02:39:11.230ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67852024-10-01T02:39:11.230ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 195.938083ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
67862024-10-01T02:39:11.235ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
67872024-10-01T02:39:11.235ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
67882024-10-01T02:39:11.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67892024-10-01T02:39:11.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67902024-10-01T02:39:11.238ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67912024-10-01T02:39:11.240ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67922024-10-01T02:39:11.240ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67932024-10-01T02:39:11.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67942024-10-01T02:39:11.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67952024-10-01T02:39:11.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67962024-10-01T02:39:11.241ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
67972024-10-01T02:39:11.243ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
67982024-10-01T02:39:11.243ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 208.933311ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
67992024-10-01T02:39:11.270ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 235.503037ms iteration = 15 status = {"physical_disks_added":0}
68002024-10-01T02:39:11.274ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
68012024-10-01T02:39:11.277ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
68022024-10-01T02:39:11.277ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68032024-10-01T02:39:11.277ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a560108a-0e84-4a1c-915e-fc9eeea15e3a", "content-length": "26", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
68042024-10-01T02:39:11.277ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68052024-10-01T02:39:11.279ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
68062024-10-01T02:39:11.402ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
68072024-10-01T02:39:11.402ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68082024-10-01T02:39:11.402ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b46a716-0822-4a79-b81c-cc51771b072e", "content-length": "26", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
68092024-10-01T02:39:11.402ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68102024-10-01T02:39:11.404ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68112024-10-01T02:39:11.424ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
68122024-10-01T02:39:11.473ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
68132024-10-01T02:39:11.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 304fba09-1e4a-467f-9184-e720419801d8 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
68142024-10-01T02:39:11.473ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2be452c3-145c-47d5-8ffe-173df89d5e54", "content-length": "2", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
68152024-10-01T02:39:11.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 304fba09-1e4a-467f-9184-e720419801d8 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
68162024-10-01T02:39:11.474ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68172024-10-01T02:39:11.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68182024-10-01T02:39:11.584ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68192024-10-01T02:39:11.585ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7e2d7cc-af2c-42f1-abb0-f38e744559e4", "content-length": "372", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
68202024-10-01T02:39:11.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68212024-10-01T02:39:11.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68222024-10-01T02:39:11.587ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 1 version = 2
68232024-10-01T02:39:11.587ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
68242024-10-01T02:39:11.587ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-01 02:33:13.765844 UTC dns_group = external generation = 2
68252024-10-01T02:39:11.587ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 553.2716ms iteration = 7 status = {"generation":2}
68262024-10-01T02:39:11.587ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68272024-10-01T02:39:11.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 304fba09-1e4a-467f-9184-e720419801d8 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
68282024-10-01T02:39:11.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68292024-10-01T02:39:11.592ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68302024-10-01T02:39:11.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68312024-10-01T02:39:11.594ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 560.833537ms iteration = 13 status = null
68322024-10-01T02:39:11.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68332024-10-01T02:39:11.595ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
68342024-10-01T02:39:11.596ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
68352024-10-01T02:39:11.596ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-01 02:33:12.369795 UTC dns_group = internal generation = 1
68362024-10-01T02:39:11.596ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 561.961087ms iteration = 7 status = {"generation":1}
68372024-10-01T02:39:11.596ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 562.229281ms iteration = 13 status = {}
68382024-10-01T02:39:11.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68392024-10-01T02:39:11.599ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
68402024-10-01T02:39:11.600ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "726306e2-3f78-4bad-b828-0b2ac2eb58ba", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
68412024-10-01T02:39:11.600ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
68422024-10-01T02:39:11.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68432024-10-01T02:39:11.602ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "24a03af9-f999-499c-ae99-c37f46288858", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
68442024-10-01T02:39:11.602ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
68452024-10-01T02:39:11.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68462024-10-01T02:39:11.603ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
68472024-10-01T02:39:11.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 570.006211ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
68482024-10-01T02:39:11.604ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
68492024-10-01T02:39:11.604ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "52d4bd36-3293-4b4d-95c1-8cb8cdb26b97", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68502024-10-01T02:39:11.604ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68512024-10-01T02:39:11.605ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68522024-10-01T02:39:11.606ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3cd25a24-cfcb-47fc-952b-bf27e215136f", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68532024-10-01T02:39:11.606ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68542024-10-01T02:39:11.607ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d43c73d3-ded4-45cb-843a-ac814f2b94e4", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
68552024-10-01T02:39:11.608ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fe13af6e-b2d5-41b3-9336-80fc8e936b8e", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68562024-10-01T02:39:11.608ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68572024-10-01T02:39:11.609ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 574.69027ms iteration = 13 status = {}
68582024-10-01T02:39:11.610ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68592024-10-01T02:39:11.610ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 576.675343ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
68602024-10-01T02:39:11.633ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-01T02:33:09.142901Z, time_modified: 2024-10-01T02:33:09.142901Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }) }
68612024-10-01T02:39:11.633ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 599.927632ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]}},"default_endpoint":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
68622024-10-01T02:39:11.638ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68632024-10-01T02:39:11.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68642024-10-01T02:39:11.640ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68652024-10-01T02:39:11.642ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68662024-10-01T02:39:11.642ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68672024-10-01T02:39:11.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68682024-10-01T02:39:11.643ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68692024-10-01T02:39:11.646ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68702024-10-01T02:39:11.646ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68712024-10-01T02:39:11.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68722024-10-01T02:39:11.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68732024-10-01T02:39:11.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68742024-10-01T02:39:11.666ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
68752024-10-01T02:39:11.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68762024-10-01T02:39:11.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68772024-10-01T02:39:11.676ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68782024-10-01T02:39:11.680ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9815a5e-2c88-4dbf-ba92-0bc4aea35426", "content-length": "121", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
68792024-10-01T02:39:11.680ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
68802024-10-01T02:39:11.680ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
68812024-10-01T02:39:11.681ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68822024-10-01T02:39:11.681ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68832024-10-01T02:39:11.681ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
68842024-10-01T02:39:11.681ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
68852024-10-01T02:39:11.681ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
68862024-10-01T02:39:11.681ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68872024-10-01T02:39:11.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68882024-10-01T02:39:11.683ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
68892024-10-01T02:39:11.684ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a0ce6f5-44f1-4688-99d1-743f32a177e0", "content-length": "2", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
68902024-10-01T02:39:11.684ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
68912024-10-01T02:39:11.684ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5573eced-1307-4037-8795-8459fa9674c7", "content-length": "52", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
68922024-10-01T02:39:11.684ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
68932024-10-01T02:39:11.684ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
68942024-10-01T02:39:11.736ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
68952024-10-01T02:39:11.768ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 366 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 97916e95-3968-4fe1-bfb2-825a2caec8cd response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
68962024-10-01T02:39:11.772ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
68972024-10-01T02:39:11.772ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
68982024-10-01T02:39:11.802ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
68992024-10-01T02:39:11.802ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5bb8efc1-7885-463a-ad8e-b9ea6daf2c4f", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
69002024-10-01T02:39:11.802ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
69012024-10-01T02:39:11.802ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "72bd510e-a9f0-438d-b5a8-af0b960e4df1", "content-length": "691", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
69022024-10-01T02:39:11.802ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
69032024-10-01T02:39:11.802ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:35896
69042024-10-01T02:39:11.803ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
69052024-10-01T02:39:11.803ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
69062024-10-01T02:39:11.803ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
69072024-10-01T02:39:11.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:35896 req_id = cc1d7c4b-07bc-449b-ac73-a84093018b39 roles = RoleSet { roles: {} } uri = /metrics/producers
69082024-10-01T02:39:11.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:35896 req_id = cc1d7c4b-07bc-449b-ac73-a84093018b39 resource = Database result = Ok(()) uri = /metrics/producers
69092024-10-01T02:39:11.803ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4a97c03-3f53-4fc6-83be-b726505669c3", "content-length": "667", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
69102024-10-01T02:39:11.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69112024-10-01T02:39:11.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69122024-10-01T02:39:11.803ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 769.022266ms iteration = 13 status = {}
69132024-10-01T02:39:11.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69142024-10-01T02:39:11.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69152024-10-01T02:39:11.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69162024-10-01T02:39:11.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69172024-10-01T02:39:11.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69182024-10-01T02:39:11.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69192024-10-01T02:39:11.835ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
69202024-10-01T02:39:11.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:35896 req_id = cc1d7c4b-07bc-449b-ac73-a84093018b39 roles = RoleSet { roles: {} } uri = /metrics/producers
69212024-10-01T02:39:11.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:35896 req_id = cc1d7c4b-07bc-449b-ac73-a84093018b39 resource = Database result = Ok(()) uri = /metrics/producers
69222024-10-01T02:39:11.841ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 807.134275ms iteration = 13 status = {}
69232024-10-01T02:39:11.868ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
69242024-10-01T02:39:11.869ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "994af469-e9d4-4812-a47a-a6b16bae5bb8", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
69252024-10-01T02:39:11.869ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
69262024-10-01T02:39:11.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67495 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:35896 req_id = cc1d7c4b-07bc-449b-ac73-a84093018b39 response_code = 201 uri = /metrics/producers
69272024-10-01T02:39:11.870ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "cc1d7c4b-07bc-449b-ac73-a84093018b39", "content-length": "41", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
69282024-10-01T02:39:11.872ZDEBGnexus (producer-registration-task): registered with nexus successfully
69292024-10-01T02:39:11.872ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
69302024-10-01T02:39:12.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c85b541e-a272-4e1b-907e-ac3d17043017 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69312024-10-01T02:39:12.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c85b541e-a272-4e1b-907e-ac3d17043017 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69322024-10-01T02:39:12.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c85b541e-a272-4e1b-907e-ac3d17043017 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69332024-10-01T02:39:13.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a34aba14-1c31-4d0f-a196-9ffbbd6f1f2e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69342024-10-01T02:39:13.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a34aba14-1c31-4d0f-a196-9ffbbd6f1f2e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69352024-10-01T02:39:13.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a34aba14-1c31-4d0f-a196-9ffbbd6f1f2e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69362024-10-01T02:39:14.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 846eab6f-8e42-44b7-8c7a-51fae2685918 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69372024-10-01T02:39:14.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 846eab6f-8e42-44b7-8c7a-51fae2685918 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69382024-10-01T02:39:14.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2669 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 846eab6f-8e42-44b7-8c7a-51fae2685918 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69392024-10-01T02:39:15.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fac0dad1-34f1-4305-ad71-60af69193454 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69402024-10-01T02:39:15.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fac0dad1-34f1-4305-ad71-60af69193454 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69412024-10-01T02:39:15.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fac0dad1-34f1-4305-ad71-60af69193454 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69422024-10-01T02:39:16.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dd59060e-0529-42bf-8906-d842b7e69b53 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69432024-10-01T02:39:16.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dd59060e-0529-42bf-8906-d842b7e69b53 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69442024-10-01T02:39:16.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = dd59060e-0529-42bf-8906-d842b7e69b53 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69452024-10-01T02:39:17.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 53420a7b-0afd-4fbc-adee-d64383e3ef9e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69462024-10-01T02:39:17.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 53420a7b-0afd-4fbc-adee-d64383e3ef9e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69472024-10-01T02:39:17.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 53420a7b-0afd-4fbc-adee-d64383e3ef9e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69482024-10-01T02:39:18.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 227f25b5-2a75-429d-a71b-3812b9283125 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69492024-10-01T02:39:18.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 227f25b5-2a75-429d-a71b-3812b9283125 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69502024-10-01T02:39:18.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2479 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 227f25b5-2a75-429d-a71b-3812b9283125 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69512024-10-01T02:39:19.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 85c5e1b4-66ab-49d4-8a16-6a0a75dca661 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69522024-10-01T02:39:19.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 85c5e1b4-66ab-49d4-8a16-6a0a75dca661 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69532024-10-01T02:39:19.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 85c5e1b4-66ab-49d4-8a16-6a0a75dca661 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69542024-10-01T02:39:20.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f07b994b-496c-4eba-bb6c-b8715ae1297d roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69552024-10-01T02:39:20.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f07b994b-496c-4eba-bb6c-b8715ae1297d resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69562024-10-01T02:39:20.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f07b994b-496c-4eba-bb6c-b8715ae1297d response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69572024-10-01T02:39:21.034ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
69582024-10-01T02:39:21.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69592024-10-01T02:39:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69602024-10-01T02:39:21.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
69612024-10-01T02:39:21.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69622024-10-01T02:39:21.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69632024-10-01T02:39:21.037ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69642024-10-01T02:39:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69652024-10-01T02:39:21.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69662024-10-01T02:39:21.063ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.500178ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69672024-10-01T02:39:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69682024-10-01T02:39:21.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69692024-10-01T02:39:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69702024-10-01T02:39:21.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69712024-10-01T02:39:21.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69722024-10-01T02:39:21.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69732024-10-01T02:39:21.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
69742024-10-01T02:39:21.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69752024-10-01T02:39:21.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69762024-10-01T02:39:21.103ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
69772024-10-01T02:39:21.103ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.942265ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
69782024-10-01T02:39:21.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7cf6d030-c76c-4494-a7ab-a3fa73dfecc9 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69792024-10-01T02:39:21.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7cf6d030-c76c-4494-a7ab-a3fa73dfecc9 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69802024-10-01T02:39:21.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7cf6d030-c76c-4494-a7ab-a3fa73dfecc9 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69812024-10-01T02:39:21.870ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 669 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 24575b0f-07ad-4679-91ff-b6f8f49b1cb5 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
69822024-10-01T02:39:22.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2d889bc2-98b7-4094-b546-b800f46302f0 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69832024-10-01T02:39:22.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2d889bc2-98b7-4094-b546-b800f46302f0 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69842024-10-01T02:39:22.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2d889bc2-98b7-4094-b546-b800f46302f0 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69852024-10-01T02:39:23.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 20012d8d-0feb-4ddd-b9c6-65a74c92a0d7 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69862024-10-01T02:39:23.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 20012d8d-0feb-4ddd-b9c6-65a74c92a0d7 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69872024-10-01T02:39:23.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2154 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 20012d8d-0feb-4ddd-b9c6-65a74c92a0d7 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69882024-10-01T02:39:24.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0e30e30f-fc5d-4901-b656-1963d6571534 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69892024-10-01T02:39:24.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0e30e30f-fc5d-4901-b656-1963d6571534 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69902024-10-01T02:39:24.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0e30e30f-fc5d-4901-b656-1963d6571534 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69912024-10-01T02:39:25.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 04243770-46d6-4506-9053-6b7c7665671e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69922024-10-01T02:39:25.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 04243770-46d6-4506-9053-6b7c7665671e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69932024-10-01T02:39:25.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 04243770-46d6-4506-9053-6b7c7665671e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69942024-10-01T02:39:26.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 348d918c-0c9d-4263-835b-e31eeac7b6b8 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69952024-10-01T02:39:26.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 348d918c-0c9d-4263-835b-e31eeac7b6b8 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69962024-10-01T02:39:26.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 348d918c-0c9d-4263-835b-e31eeac7b6b8 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69972024-10-01T02:39:27.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 550f149b-7407-4646-b6b7-cfc7bc29fc1b roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69982024-10-01T02:39:27.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 550f149b-7407-4646-b6b7-cfc7bc29fc1b resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
69992024-10-01T02:39:27.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 550f149b-7407-4646-b6b7-cfc7bc29fc1b response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70002024-10-01T02:39:28.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f7931438-9f71-4cb2-821b-ff51f3adf9a6 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70012024-10-01T02:39:28.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f7931438-9f71-4cb2-821b-ff51f3adf9a6 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70022024-10-01T02:39:28.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f7931438-9f71-4cb2-821b-ff51f3adf9a6 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70032024-10-01T02:39:29.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7512338e-c805-46a7-b076-99fe4b1e6215 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70042024-10-01T02:39:29.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7512338e-c805-46a7-b076-99fe4b1e6215 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70052024-10-01T02:39:29.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1647 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7512338e-c805-46a7-b076-99fe4b1e6215 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70062024-10-01T02:39:31.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 27d1661b-2afe-4950-b485-05c9e57f5b93 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70072024-10-01T02:39:31.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 27d1661b-2afe-4950-b485-05c9e57f5b93 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70082024-10-01T02:39:31.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 27d1661b-2afe-4950-b485-05c9e57f5b93 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70092024-10-01T02:39:31.034ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
70102024-10-01T02:39:31.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70112024-10-01T02:39:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70122024-10-01T02:39:31.034ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
70132024-10-01T02:39:31.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70142024-10-01T02:39:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70152024-10-01T02:39:31.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70162024-10-01T02:39:31.036ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70172024-10-01T02:39:31.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70182024-10-01T02:39:31.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70192024-10-01T02:39:31.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70202024-10-01T02:39:31.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70212024-10-01T02:39:31.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70222024-10-01T02:39:31.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70232024-10-01T02:39:31.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70242024-10-01T02:39:31.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
70252024-10-01T02:39:31.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70262024-10-01T02:39:31.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70272024-10-01T02:39:31.052ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
70282024-10-01T02:39:31.052ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.685286ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
70292024-10-01T02:39:31.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.710038ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70302024-10-01T02:39:31.870ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 379 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = a65dcf09-a382-4ec3-8b44-93d2382bc25f response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
70312024-10-01T02:39:32.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 538ef220-7bb8-4ed6-9f76-64a496e4c76c roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70322024-10-01T02:39:32.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 538ef220-7bb8-4ed6-9f76-64a496e4c76c resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70332024-10-01T02:39:32.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2631 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 538ef220-7bb8-4ed6-9f76-64a496e4c76c response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70342024-10-01T02:39:33.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 01307853-a33b-45b3-b488-c420b9ceb95b roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70352024-10-01T02:39:33.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 01307853-a33b-45b3-b488-c420b9ceb95b resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70362024-10-01T02:39:33.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2368 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 01307853-a33b-45b3-b488-c420b9ceb95b response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70372024-10-01T02:39:34.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fbad426c-eae8-47d6-a51a-86fcfc2013b3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70382024-10-01T02:39:34.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fbad426c-eae8-47d6-a51a-86fcfc2013b3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70392024-10-01T02:39:34.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1723 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fbad426c-eae8-47d6-a51a-86fcfc2013b3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70402024-10-01T02:39:35.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 88175bd6-0b78-4033-916c-4f0be5b25774 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70412024-10-01T02:39:35.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 88175bd6-0b78-4033-916c-4f0be5b25774 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70422024-10-01T02:39:35.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1968 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 88175bd6-0b78-4033-916c-4f0be5b25774 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70432024-10-01T02:39:36.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a223cd11-530a-46ee-a80c-bc8fa1c5816c roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70442024-10-01T02:39:36.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a223cd11-530a-46ee-a80c-bc8fa1c5816c resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70452024-10-01T02:39:36.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a223cd11-530a-46ee-a80c-bc8fa1c5816c response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70462024-10-01T02:39:37.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = df1eaee2-c664-410b-accf-f715b78b7ae5 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70472024-10-01T02:39:37.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = df1eaee2-c664-410b-accf-f715b78b7ae5 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70482024-10-01T02:39:37.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = df1eaee2-c664-410b-accf-f715b78b7ae5 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70492024-10-01T02:39:38.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 089d920a-b480-496c-8888-f8a3fdd986dd roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70502024-10-01T02:39:38.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 089d920a-b480-496c-8888-f8a3fdd986dd resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70512024-10-01T02:39:38.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 089d920a-b480-496c-8888-f8a3fdd986dd response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70522024-10-01T02:39:39.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 113d4a44-1066-4fdc-871f-617d7d619cb8 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70532024-10-01T02:39:39.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 113d4a44-1066-4fdc-871f-617d7d619cb8 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70542024-10-01T02:39:39.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1734 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 113d4a44-1066-4fdc-871f-617d7d619cb8 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70552024-10-01T02:39:40.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 342bc7a2-93fc-4375-b57f-31f3a3bbe0e8 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70562024-10-01T02:39:40.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 342bc7a2-93fc-4375-b57f-31f3a3bbe0e8 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70572024-10-01T02:39:40.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 342bc7a2-93fc-4375-b57f-31f3a3bbe0e8 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
70582024-10-01T02:39:41.034ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
70592024-10-01T02:39:41.034ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
70602024-10-01T02:39:41.034ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70612024-10-01T02:39:41.034ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
70622024-10-01T02:39:41.034ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
70632024-10-01T02:39:41.034ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
70642024-10-01T02:39:41.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70652024-10-01T02:39:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70662024-10-01T02:39:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
70672024-10-01T02:39:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70682024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
70692024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
70702024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70712024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
70722024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70732024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70742024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
70752024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
70762024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70772024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70782024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
70792024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70802024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
70812024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
70822024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
70832024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
70842024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70852024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
70862024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70872024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
70882024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70892024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
70902024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
70912024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
70922024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70932024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
70942024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70952024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70962024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70972024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70982024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70992024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
71002024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71012024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71022024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71032024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71042024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71052024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
71062024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71072024-10-01T02:39:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71082024-10-01T02:39:41.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71092024-10-01T02:39:41.038ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.561816ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71102024-10-01T02:39:41.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71112024-10-01T02:39:41.038ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1634, tv_nsec: 479061674 } })
71122024-10-01T02:39:41.038ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1634, tv_nsec: 479088685 } })
71132024-10-01T02:39:41.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71142024-10-01T02:39:41.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71152024-10-01T02:39:41.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71162024-10-01T02:39:41.039ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
71172024-10-01T02:39:41.040ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
71182024-10-01T02:39:41.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
71192024-10-01T02:39:41.040ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71202024-10-01T02:39:41.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71212024-10-01T02:39:41.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71222024-10-01T02:39:41.042ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.727633ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
71232024-10-01T02:39:41.042ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71242024-10-01T02:39:41.043ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71252024-10-01T02:39:41.043ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71262024-10-01T02:39:41.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71272024-10-01T02:39:41.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71282024-10-01T02:39:41.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71292024-10-01T02:39:41.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71302024-10-01T02:39:41.044ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71312024-10-01T02:39:41.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71322024-10-01T02:39:41.047ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71332024-10-01T02:39:41.047ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71342024-10-01T02:39:41.047ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71352024-10-01T02:39:41.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71362024-10-01T02:39:41.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71372024-10-01T02:39:41.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71382024-10-01T02:39:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71392024-10-01T02:39:41.050ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1634, tv_nsec: 490326683 } })
71402024-10-01T02:39:41.050ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
71412024-10-01T02:39:41.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
71422024-10-01T02:39:41.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71432024-10-01T02:39:41.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71442024-10-01T02:39:41.053ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71452024-10-01T02:39:41.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71462024-10-01T02:39:41.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71472024-10-01T02:39:41.054ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71482024-10-01T02:39:41.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71492024-10-01T02:39:41.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
71502024-10-01T02:39:41.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71512024-10-01T02:39:41.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71522024-10-01T02:39:41.080ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
71532024-10-01T02:39:41.080ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.97133ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
71542024-10-01T02:39:41.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71552024-10-01T02:39:41.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71562024-10-01T02:39:41.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.224588ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
71572024-10-01T02:39:41.094ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71582024-10-01T02:39:41.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71592024-10-01T02:39:41.097ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71602024-10-01T02:39:41.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71612024-10-01T02:39:41.098ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71622024-10-01T02:39:41.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71632024-10-01T02:39:41.099ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.620186ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71642024-10-01T02:39:41.100ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.448837ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71652024-10-01T02:39:41.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71662024-10-01T02:39:41.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71672024-10-01T02:39:41.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71682024-10-01T02:39:41.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71692024-10-01T02:39:41.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71702024-10-01T02:39:41.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71712024-10-01T02:39:41.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 69.558505ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
71722024-10-01T02:39:41.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71732024-10-01T02:39:41.108ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71742024-10-01T02:39:41.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71752024-10-01T02:39:41.108ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71762024-10-01T02:39:41.108ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
71772024-10-01T02:39:41.108ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71782024-10-01T02:39:41.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71792024-10-01T02:39:41.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71802024-10-01T02:39:41.113ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71812024-10-01T02:39:41.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71822024-10-01T02:39:41.115ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71832024-10-01T02:39:41.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71842024-10-01T02:39:41.135ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71852024-10-01T02:39:41.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71862024-10-01T02:39:41.144ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
71872024-10-01T02:39:41.144ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71882024-10-01T02:39:41.145ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a52595a5-0509-46e5-b0f9-15515787c0a8", "content-length": "26", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
71892024-10-01T02:39:41.145ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71902024-10-01T02:39:41.147ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71912024-10-01T02:39:41.147ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71922024-10-01T02:39:41.149ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
71932024-10-01T02:39:41.149ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71942024-10-01T02:39:41.151ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b97ff718-9975-4d87-96ff-e27a16322732", "content-length": "26", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
71952024-10-01T02:39:41.151ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71962024-10-01T02:39:41.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
71972024-10-01T02:39:41.151ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71982024-10-01T02:39:41.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71992024-10-01T02:39:41.153ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72002024-10-01T02:39:41.161ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72012024-10-01T02:39:41.161ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
72022024-10-01T02:39:41.161ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 126.036142ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
72032024-10-01T02:39:41.174ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72042024-10-01T02:39:41.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72052024-10-01T02:39:41.175ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 140.355792ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
72062024-10-01T02:39:41.187ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
72072024-10-01T02:39:41.187ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72082024-10-01T02:39:41.187ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec8f5108-3de5-4b39-88ff-a40e2e1e9e45", "content-length": "26", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
72092024-10-01T02:39:41.187ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72102024-10-01T02:39:41.189ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
72112024-10-01T02:39:41.227ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 191.896026ms iteration = 16 status = {"physical_disks_added":0}
72122024-10-01T02:39:41.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 534a2d3b-a40b-4337-abee-55f2e57192a8 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
72132024-10-01T02:39:41.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 534a2d3b-a40b-4337-abee-55f2e57192a8 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
72142024-10-01T02:39:41.315ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/031b6427-1460-4676-a469-9de2f0f9317d/state
72152024-10-01T02:39:41.357ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72162024-10-01T02:39:41.358ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "15c69b96-1282-4713-8369-7283460fe351", "content-length": "525", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
72172024-10-01T02:39:41.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72182024-10-01T02:39:41.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72192024-10-01T02:39:41.360ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 324.707721ms iteration = 14 status = 0
72202024-10-01T02:39:41.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 534a2d3b-a40b-4337-abee-55f2e57192a8 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
72212024-10-01T02:39:41.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72222024-10-01T02:39:41.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72232024-10-01T02:39:41.366ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72242024-10-01T02:39:41.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72252024-10-01T02:39:41.366ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72262024-10-01T02:39:41.367ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff25c54e-4962-4e0f-baf4-cceda8d9ea4e", "content-length": "2", "date": "Tue, 01 Oct 2024 02:39:40 GMT"} })
72272024-10-01T02:39:41.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72282024-10-01T02:39:41.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72292024-10-01T02:39:41.369ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72302024-10-01T02:39:41.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72312024-10-01T02:39:41.371ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 337.77531ms iteration = 14 status = null
72322024-10-01T02:39:41.372ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72332024-10-01T02:39:41.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72342024-10-01T02:39:41.374ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 340.666788ms iteration = 14 status = {}
72352024-10-01T02:39:41.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72362024-10-01T02:39:41.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72372024-10-01T02:39:41.380ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72382024-10-01T02:39:41.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72392024-10-01T02:39:41.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72402024-10-01T02:39:41.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72412024-10-01T02:39:41.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72422024-10-01T02:39:41.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72432024-10-01T02:39:41.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72442024-10-01T02:39:41.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72452024-10-01T02:39:41.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72462024-10-01T02:39:41.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72472024-10-01T02:39:41.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72482024-10-01T02:39:41.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72492024-10-01T02:39:41.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72502024-10-01T02:39:41.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72512024-10-01T02:39:41.403ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72522024-10-01T02:39:41.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72532024-10-01T02:39:41.405ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72542024-10-01T02:39:41.407ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72552024-10-01T02:39:41.407ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72562024-10-01T02:39:41.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72572024-10-01T02:39:41.409ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72582024-10-01T02:39:41.411ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72592024-10-01T02:39:41.411ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72602024-10-01T02:39:41.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72612024-10-01T02:39:41.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72622024-10-01T02:39:41.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: ade3b588-424d-4931-8c7d-7d3a43246cab, lookup_type: ById(ade3b588-424d-4931-8c7d-7d3a43246cab) }, key: d49ff824-f5ef-4d81-a17d-b4be51613bfa, lookup_type: ById(d49ff824-f5ef-4d81-a17d-b4be51613bfa) }, key: dea4016b-b2c4-47f9-aae4-43f76982ca79, lookup_type: ById(dea4016b-b2c4-47f9-aae4-43f76982ca79) } result = Ok(())
72632024-10-01T02:39:41.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72642024-10-01T02:39:41.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72652024-10-01T02:39:41.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72662024-10-01T02:39:41.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72672024-10-01T02:39:41.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72682024-10-01T02:39:41.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72692024-10-01T02:39:41.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72702024-10-01T02:39:41.454ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: ade3b588-424d-4931-8c7d-7d3a43246cab, lookup_type: ById(ade3b588-424d-4931-8c7d-7d3a43246cab) }, key: d49ff824-f5ef-4d81-a17d-b4be51613bfa, lookup_type: ById(d49ff824-f5ef-4d81-a17d-b4be51613bfa) }, key: dea4016b-b2c4-47f9-aae4-43f76982ca79, lookup_type: ById(dea4016b-b2c4-47f9-aae4-43f76982ca79) } result = Ok(())
72712024-10-01T02:39:41.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72722024-10-01T02:39:41.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72732024-10-01T02:39:41.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72742024-10-01T02:39:41.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72752024-10-01T02:39:41.464ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
72762024-10-01T02:39:41.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72772024-10-01T02:39:41.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72782024-10-01T02:39:41.465ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72792024-10-01T02:39:41.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72802024-10-01T02:39:41.468ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72812024-10-01T02:39:41.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72822024-10-01T02:39:41.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72832024-10-01T02:39:41.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72842024-10-01T02:39:41.472ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72852024-10-01T02:39:41.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72862024-10-01T02:39:41.476ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72872024-10-01T02:39:41.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72882024-10-01T02:39:41.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72892024-10-01T02:39:41.477ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72902024-10-01T02:39:41.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72912024-10-01T02:39:41.477ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "81148ec0-d3e3-4825-82a4-82da0c817ec2", "content-length": "121", "date": "Tue, 01 Oct 2024 02:39:40 GMT"} })
72922024-10-01T02:39:41.477ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
72932024-10-01T02:39:41.477ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
72942024-10-01T02:39:41.478ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72952024-10-01T02:39:41.478ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72962024-10-01T02:39:41.478ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
72972024-10-01T02:39:41.478ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
72982024-10-01T02:39:41.478ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
72992024-10-01T02:39:41.478ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73002024-10-01T02:39:41.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73012024-10-01T02:39:41.479ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73022024-10-01T02:39:41.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73032024-10-01T02:39:41.481ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
73042024-10-01T02:39:41.481ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "983afcea-0271-4f8a-a1a9-86f479da05d2", "content-length": "2", "date": "Tue, 01 Oct 2024 02:39:40 GMT"} })
73052024-10-01T02:39:41.481ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73062024-10-01T02:39:41.481ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
73072024-10-01T02:39:41.481ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0b07ac0-3bd4-4aa3-9fbb-e3f80ff71d3b", "content-length": "52", "date": "Tue, 01 Oct 2024 02:39:40 GMT"} })
73082024-10-01T02:39:41.481ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
73092024-10-01T02:39:41.481ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
73102024-10-01T02:39:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: ade3b588-424d-4931-8c7d-7d3a43246cab, lookup_type: ById(ade3b588-424d-4931-8c7d-7d3a43246cab) }, key: d49ff824-f5ef-4d81-a17d-b4be51613bfa, lookup_type: ById(d49ff824-f5ef-4d81-a17d-b4be51613bfa) }, key: ffc36cea-d444-4c75-a52d-99f99f803e0a, lookup_type: ByName("default") } result = Ok(())
73112024-10-01T02:39:41.500ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73122024-10-01T02:39:41.535ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
73132024-10-01T02:39:41.640ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e4725d2c-1716-47f9-bfe9-174c8ad63938", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
73142024-10-01T02:39:41.640ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
73152024-10-01T02:39:41.640ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
73162024-10-01T02:39:41.647ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bf37160-0840-495d-82ed-abf58f1b64cf", "content-length": "811", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
73172024-10-01T02:39:41.647ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(12861255) }} sled = buskin
73182024-10-01T02:39:41.647ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
73192024-10-01T02:39:41.647ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
73202024-10-01T02:39:41.649ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 614.377785ms iteration = 14 status = {}
73212024-10-01T02:39:41.649ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0412d8d5-6f49-47da-9e71-ddd9aadb0ab6", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
73222024-10-01T02:39:41.649ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "57031c66-dfe6-4b16-a944-7152b3332562", "content-length": "667", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
73232024-10-01T02:39:41.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73242024-10-01T02:39:41.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73252024-10-01T02:39:41.652ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 616.803776ms iteration = 14 status = {}
73262024-10-01T02:39:41.654ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73272024-10-01T02:39:41.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73282024-10-01T02:39:41.658ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73292024-10-01T02:39:41.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73302024-10-01T02:39:41.660ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73312024-10-01T02:39:41.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73322024-10-01T02:39:41.669ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 634.185766ms iteration = 14 status = {}
73332024-10-01T02:39:41.872ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1081 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = fbf7ae12-b5cf-4d15-85c7-99378e8ecbf4 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
73342024-10-01T02:39:42.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 10f8ea73-7c36-4433-96b5-34c2180a0add roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73352024-10-01T02:39:42.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 10f8ea73-7c36-4433-96b5-34c2180a0add resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73362024-10-01T02:39:42.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 10f8ea73-7c36-4433-96b5-34c2180a0add response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73372024-10-01T02:39:43.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 72f909d3-ef8d-4183-9eb2-79431f1985f3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73382024-10-01T02:39:43.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 72f909d3-ef8d-4183-9eb2-79431f1985f3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73392024-10-01T02:39:43.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 72f909d3-ef8d-4183-9eb2-79431f1985f3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73402024-10-01T02:39:44.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 003ffb30-cded-412e-a31d-04860077e3fe roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73412024-10-01T02:39:44.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 003ffb30-cded-412e-a31d-04860077e3fe resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73422024-10-01T02:39:44.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 003ffb30-cded-412e-a31d-04860077e3fe response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73432024-10-01T02:39:45.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b95134fd-2312-4a68-afa2-fe286a234421 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73442024-10-01T02:39:45.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b95134fd-2312-4a68-afa2-fe286a234421 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73452024-10-01T02:39:45.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b95134fd-2312-4a68-afa2-fe286a234421 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73462024-10-01T02:39:46.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2df2fafc-8f1f-4e0f-b7da-c0a36e8a6ce7 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73472024-10-01T02:39:46.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2df2fafc-8f1f-4e0f-b7da-c0a36e8a6ce7 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73482024-10-01T02:39:46.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2df2fafc-8f1f-4e0f-b7da-c0a36e8a6ce7 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73492024-10-01T02:39:47.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = da1332e9-fd4b-4f87-b83b-ef08eecb7d9d roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73502024-10-01T02:39:47.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = da1332e9-fd4b-4f87-b83b-ef08eecb7d9d resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73512024-10-01T02:39:47.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = da1332e9-fd4b-4f87-b83b-ef08eecb7d9d response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73522024-10-01T02:39:47.980ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/031b6427-1460-4676-a469-9de2f0f9317d/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7751c83-996a-47a8-b70e-fb17d10bb8a3", "content-length": "131", "date": "Tue, 01 Oct 2024 02:39:47 GMT"} })
73532024-10-01T02:39:47.994ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 sled_id = 2a571ec0-85a3-450e-88fc-680c13ffa211 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-10-01T02:39:39.578732322Z }, migration_in: None, migration_out: None } vmm_id = 031b6427-1460-4676-a469-9de2f0f9317d
73542024-10-01T02:39:47.997ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2043 instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 031b6427-1460-4676-a469-9de2f0f9317d sled_id = 2a571ec0-85a3-450e-88fc-680c13ffa211 vmm_id = 031b6427-1460-4676-a469-9de2f0f9317d vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-10-01T02:39:39.578732322Z }
73552024-10-01T02:39:47.997ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 roles = RoleSet { roles: {} } sled_id = 2a571ec0-85a3-450e-88fc-680c13ffa211 vmm_id = 031b6427-1460-4676-a469-9de2f0f9317d
73562024-10-01T02:39:47.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 resource = Database result = Ok(()) sled_id = 2a571ec0-85a3-450e-88fc-680c13ffa211 vmm_id = 031b6427-1460-4676-a469-9de2f0f9317d
73572024-10-01T02:39:48.010ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
73582024-10-01T02:39:48.011ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2043 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 031b6427-1460-4676-a469-9de2f0f9317d remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 23ca6a95-c2ea-4cee-b655-513f9b193cb3 uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-10-01T02:39:47.981324803Z }
73592024-10-01T02:39:48.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 23ca6a95-c2ea-4cee-b655-513f9b193cb3 roles = RoleSet { roles: {} } uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
73602024-10-01T02:39:48.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 23ca6a95-c2ea-4cee-b655-513f9b193cb3 resource = Database result = Ok(()) uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
73612024-10-01T02:39:48.012ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 6.97675766s iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
73622024-10-01T02:39:48.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61343 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 23ca6a95-c2ea-4cee-b655-513f9b193cb3 response_code = 204 uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
73632024-10-01T02:39:48.059ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2043 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 031b6427-1460-4676-a469-9de2f0f9317d remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b49f42d1-7ae6-40a0-a128-3ee2ca2b8dd1 uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-10-01T02:39:48.059406881Z }
73642024-10-01T02:39:48.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b49f42d1-7ae6-40a0-a128-3ee2ca2b8dd1 roles = RoleSet { roles: {} } uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
73652024-10-01T02:39:48.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b49f42d1-7ae6-40a0-a128-3ee2ca2b8dd1 resource = Database result = Ok(()) uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
73662024-10-01T02:39:48.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 12895 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b49f42d1-7ae6-40a0-a128-3ee2ca2b8dd1 response_code = 204 uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
73672024-10-01T02:39:48.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0e6b3dfb-bde1-4e72-9064-172f64ef68a3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73682024-10-01T02:39:48.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0e6b3dfb-bde1-4e72-9064-172f64ef68a3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73692024-10-01T02:39:48.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0e6b3dfb-bde1-4e72-9064-172f64ef68a3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73702024-10-01T02:39:49.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7c866c92-a232-48ce-8154-4ce327a63c1c roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73712024-10-01T02:39:49.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7c866c92-a232-48ce-8154-4ce327a63c1c resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73722024-10-01T02:39:49.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2773 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7c866c92-a232-48ce-8154-4ce327a63c1c response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73732024-10-01T02:39:50.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 80c4c613-2b55-423c-8fed-86dd056b3bfd roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73742024-10-01T02:39:50.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 80c4c613-2b55-423c-8fed-86dd056b3bfd resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73752024-10-01T02:39:50.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2640 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 80c4c613-2b55-423c-8fed-86dd056b3bfd response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73762024-10-01T02:39:51.034ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
73772024-10-01T02:39:51.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73782024-10-01T02:39:51.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73792024-10-01T02:39:51.035ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
73802024-10-01T02:39:51.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73812024-10-01T02:39:51.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73822024-10-01T02:39:51.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73832024-10-01T02:39:51.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73842024-10-01T02:39:51.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73852024-10-01T02:39:51.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73862024-10-01T02:39:51.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73872024-10-01T02:39:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73882024-10-01T02:39:51.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73892024-10-01T02:39:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
73902024-10-01T02:39:51.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73912024-10-01T02:39:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73922024-10-01T02:39:51.054ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
73932024-10-01T02:39:51.054ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.65515ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
73942024-10-01T02:39:51.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73952024-10-01T02:39:51.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73962024-10-01T02:39:51.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.076241ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73972024-10-01T02:39:51.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 22dea681-b729-4122-b86e-c285b7b20270 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73982024-10-01T02:39:51.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 22dea681-b729-4122-b86e-c285b7b20270 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
73992024-10-01T02:39:51.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1822 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 22dea681-b729-4122-b86e-c285b7b20270 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74002024-10-01T02:39:51.874ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3473 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = dd0d35a2-2b35-4149-9d5a-d917cca9d42e response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
74012024-10-01T02:39:52.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e6986d0e-2015-4ca5-9900-f28ae3ff73dc roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74022024-10-01T02:39:52.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e6986d0e-2015-4ca5-9900-f28ae3ff73dc resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74032024-10-01T02:39:52.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e6986d0e-2015-4ca5-9900-f28ae3ff73dc response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74042024-10-01T02:39:53.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5321565b-8e4e-497a-8594-dec7ac3785c0 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74052024-10-01T02:39:53.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5321565b-8e4e-497a-8594-dec7ac3785c0 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74062024-10-01T02:39:53.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5321565b-8e4e-497a-8594-dec7ac3785c0 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74072024-10-01T02:39:54.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6d9d0a1e-302d-4ee8-814f-3967af2042e6 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74082024-10-01T02:39:54.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6d9d0a1e-302d-4ee8-814f-3967af2042e6 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74092024-10-01T02:39:54.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6d9d0a1e-302d-4ee8-814f-3967af2042e6 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74102024-10-01T02:39:55.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3f282e14-4d76-4f6a-810f-c9f6e4743b45 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74112024-10-01T02:39:55.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3f282e14-4d76-4f6a-810f-c9f6e4743b45 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74122024-10-01T02:39:55.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3f282e14-4d76-4f6a-810f-c9f6e4743b45 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74132024-10-01T02:39:56.557ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2043 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 031b6427-1460-4676-a469-9de2f0f9317d remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 836b3283-0cc5-4dd3-8f33-dbebc3befd6e uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-10-01T02:39:56.557325359Z }
74142024-10-01T02:39:56.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 836b3283-0cc5-4dd3-8f33-dbebc3befd6e roles = RoleSet { roles: {} } uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74152024-10-01T02:39:56.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 836b3283-0cc5-4dd3-8f33-dbebc3befd6e resource = Database result = Ok(()) uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74162024-10-01T02:39:56.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55678 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 836b3283-0cc5-4dd3-8f33-dbebc3befd6e response_code = 204 uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74172024-10-01T02:39:56.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9d7d7b94-983a-46e4-ac73-cbf812ff5206 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74182024-10-01T02:39:56.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9d7d7b94-983a-46e4-ac73-cbf812ff5206 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74192024-10-01T02:39:56.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9d7d7b94-983a-46e4-ac73-cbf812ff5206 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74202024-10-01T02:39:57.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e9dab4e9-8b05-4a0e-a88a-6163c2b597ef roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74212024-10-01T02:39:57.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e9dab4e9-8b05-4a0e-a88a-6163c2b597ef resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74222024-10-01T02:39:57.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e9dab4e9-8b05-4a0e-a88a-6163c2b597ef response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74232024-10-01T02:39:58.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5ca5ee5b-621a-4f6d-9992-bbfa8efd2b96 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74242024-10-01T02:39:58.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5ca5ee5b-621a-4f6d-9992-bbfa8efd2b96 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74252024-10-01T02:39:58.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5ca5ee5b-621a-4f6d-9992-bbfa8efd2b96 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
74262024-10-01T02:39:59.031ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2043 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 031b6427-1460-4676-a469-9de2f0f9317d remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-01T02:39:59.031013960Z }
74272024-10-01T02:39:59.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c roles = RoleSet { roles: {} } uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74282024-10-01T02:39:59.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c resource = Database result = Ok(()) uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74292024-10-01T02:39:59.050ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 031b6427-1460-4676-a469-9de2f0f9317d remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d vmm_needs_update = true
74302024-10-01T02:39:59.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c roles = RoleSet { roles: {} } uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74312024-10-01T02:39:59.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c resource = Database result = Ok(()) uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74322024-10-01T02:39:59.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c roles = RoleSet { roles: {} } uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74332024-10-01T02:39:59.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c resource = Database result = Ok(()) uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74342024-10-01T02:39:59.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c roles = RoleSet { roles: {} } uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74352024-10-01T02:39:59.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c resource = Database result = Ok(()) uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74362024-10-01T02:39:59.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c roles = RoleSet { roles: {} } uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74372024-10-01T02:39:59.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c resource = Database result = Ok(()) uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74382024-10-01T02:39:59.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c roles = RoleSet { roles: {} } uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74392024-10-01T02:39:59.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c resource = Database result = Ok(()) uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74402024-10-01T02:39:59.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c roles = RoleSet { roles: {} } uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74412024-10-01T02:39:59.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c resource = Database result = Ok(()) uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74422024-10-01T02:39:59.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74432024-10-01T02:39:59.074ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: ade3b588-424d-4931-8c7d-7d3a43246cab, lookup_type: ById(ade3b588-424d-4931-8c7d-7d3a43246cab) }, key: 155a6d94-b6d1-469e-afb5-9a278b60eab5, lookup_type: ById(155a6d94-b6d1-469e-afb5-9a278b60eab5) } result = Ok(()) uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74442024-10-01T02:39:59.084ZINFOnexus (dropshot_internal): starting update saga for 155a6d94-b6d1-469e-afb5-9a278b60eab5 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1518 instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-01T02:39:59.031013960Z }
74452024-10-01T02:39:59.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53419 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c response_code = 204 uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74462024-10-01T02:39:59.084ZDEBGnexus (dropshot_internal): preparing instance-update saga for 155a6d94-b6d1-469e-afb5-9a278b60eab5... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d05c20ac-8f97-4dac-a1ae-c57e5a01580c uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74472024-10-01T02:39:59.085ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2043 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 031b6427-1460-4676-a469-9de2f0f9317d remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5b2aea34-46fa-46a0-9351-7ed0d849ad4b uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-01T02:39:59.031013960Z }
74482024-10-01T02:39:59.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5b2aea34-46fa-46a0-9351-7ed0d849ad4b roles = RoleSet { roles: {} } uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74492024-10-01T02:39:59.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5b2aea34-46fa-46a0-9351-7ed0d849ad4b resource = Database result = Ok(()) uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74502024-10-01T02:39:59.087ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update
74512024-10-01T02:39:59.092ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"155a6d94-b6d1-469e-afb5-9a278b60eab5","lookup_type":{"ById":"155a6d94-b6d1-469e-afb5-9a278b60eab5"},"parent":{"key":"ade3b588-424d-4931-8c7d-7d3a43246cab","lookup_type":{"ById":"ade3b588-424d-4931-8c7d-7d3a43246cab"},"parent":{"key":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","lookup_type":{"ById":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
74522024-10-01T02:39:59.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8842 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5b2aea34-46fa-46a0-9351-7ed0d849ad4b response_code = 204 uri = /vmms/031b6427-1460-4676-a469-9de2f0f9317d
74532024-10-01T02:39:59.094ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update
74542024-10-01T02:39:59.135ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update
74552024-10-01T02:39:59.135ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
74562024-10-01T02:39:59.135ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
74572024-10-01T02:39:59.135ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b
74582024-10-01T02:39:59.156ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
74592024-10-01T02:39:59.156ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b
74602024-10-01T02:39:59.162ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
74612024-10-01T02:39:59.162ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b
74622024-10-01T02:39:59.174ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
74632024-10-01T02:39:59.174ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("22cf7205-cd4f-4fad-a50b-a5b58405a44a")) node_id = 0 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b
74642024-10-01T02:39:59.179ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
74652024-10-01T02:39:59.179ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b
74662024-10-01T02:39:59.191ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update
74672024-10-01T02:39:59.191ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74682024-10-01T02:39:59.191ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74692024-10-01T02:39:59.194ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74702024-10-01T02:39:59.194ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74712024-10-01T02:39:59.196ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74722024-10-01T02:39:59.196ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74732024-10-01T02:39:59.198ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74742024-10-01T02:39:59.198ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74752024-10-01T02:39:59.199ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74762024-10-01T02:39:59.199ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74772024-10-01T02:39:59.200ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74782024-10-01T02:39:59.201ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74792024-10-01T02:39:59.202ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74802024-10-01T02:39:59.205ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: ade3b588-424d-4931-8c7d-7d3a43246cab, lookup_type: ById(ade3b588-424d-4931-8c7d-7d3a43246cab) }, key: 155a6d94-b6d1-469e-afb5-9a278b60eab5, lookup_type: ById(155a6d94-b6d1-469e-afb5-9a278b60eab5) } result = Ok(()) saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74812024-10-01T02:39:59.205ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance updater_id = 22cf7205-cd4f-4fad-a50b-a5b58405a44a
74822024-10-01T02:39:59.205ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74832024-10-01T02:39:59.205ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74842024-10-01T02:39:59.223ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance updater_id = 22cf7205-cd4f-4fad-a50b-a5b58405a44a
74852024-10-01T02:39:59.224ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74862024-10-01T02:39:59.224ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance
74872024-10-01T02:39:59.228ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 locked_gen = Generation(Generation(2)) saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = LockInstance updater_id = 22cf7205-cd4f-4fad-a50b-a5b58405a44a
74882024-10-01T02:39:59.231ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
74892024-10-01T02:39:59.231ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("22cf7205-cd4f-4fad-a50b-a5b58405a44a")}) node_id = 1 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b
74902024-10-01T02:39:59.235ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
74912024-10-01T02:39:59.235ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b
74922024-10-01T02:39:59.244ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
74932024-10-01T02:39:59.244ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
74942024-10-01T02:39:59.245ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
74952024-10-01T02:39:59.245ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
74962024-10-01T02:39:59.246ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
74972024-10-01T02:39:59.247ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
74982024-10-01T02:39:59.248ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
74992024-10-01T02:39:59.251ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: ade3b588-424d-4931-8c7d-7d3a43246cab, lookup_type: ById(ade3b588-424d-4931-8c7d-7d3a43246cab) }, key: 155a6d94-b6d1-469e-afb5-9a278b60eab5, lookup_type: ById(155a6d94-b6d1-469e-afb5-9a278b60eab5) } result = Ok(()) saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
75002024-10-01T02:39:59.251ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
75012024-10-01T02:39:59.251ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
75022024-10-01T02:39:59.259ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 031b6427-1460-4676-a469-9de2f0f9317d, time_created: 2024-10-01T02:39:38.982252Z, time_deleted: None, instance_id: 155a6d94-b6d1-469e-afb5-9a278b60eab5, sled_id: 2a571ec0-85a3-450e-88fc-680c13ffa211, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-10-01T02:39:59.031013Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-10-01T02:39:36.681058Z, gen: Generation(Generation(3)), propolis_id: Some(031b6427-1460-4676-a469-9de2f0f9317d), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(031b6427-1460-4676-a469-9de2f0f9317d (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-10-01T02:39:59.259073112Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
75032024-10-01T02:39:59.259ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update
75042024-10-01T02:39:59.259ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"155a6d94-b6d1-469e-afb5-9a278b60eab5","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"031b6427-1460-4676-a469-9de2f0f9317d"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"155a6d94-b6d1-469e-afb5-9a278b60eab5","lookup_type":{"ById":"155a6d94-b6d1-469e-afb5-9a278b60eab5"},"parent":{"key":"ade3b588-424d-4931-8c7d-7d3a43246cab","lookup_type":{"ById":"ade3b588-424d-4931-8c7d-7d3a43246cab"},"parent":{"key":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","lookup_type":{"ById":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"22cf7205-cd4f-4fad-a50b-a5b58405a44a"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"ade3b588-424d-4931-8c7d-7d3a43246cab","ram_diff":1073741824},"destroy_active_vmm":"031b6427-1460-4676-a469-9de2f0f9317d","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-10-01T02:39:59.259073112Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75052024-10-01T02:39:59.259ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update
75062024-10-01T02:39:59.265ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update
75072024-10-01T02:39:59.265ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75082024-10-01T02:39:59.265ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75092024-10-01T02:39:59.265ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
75102024-10-01T02:39:59.271ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75112024-10-01T02:39:59.271ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
75122024-10-01T02:39:59.280ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75132024-10-01T02:39:59.280ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
75142024-10-01T02:39:59.286ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75152024-10-01T02:39:59.286ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("3c84b08b-42e5-4f84-b10a-8c44c0d0489a")) node_id = 0 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
75162024-10-01T02:39:59.293ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75172024-10-01T02:39:59.293ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
75182024-10-01T02:39:59.302ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 parent_lock = UpdaterLock { updater_id: 22cf7205-cd4f-4fad-a50b-a5b58405a44a, locked_gen: Generation(Generation(2)) } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update
75192024-10-01T02:39:59.302ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = BecomeUpdater
75202024-10-01T02:39:59.303ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = BecomeUpdater
75212024-10-01T02:39:59.315ZDEBGnexus (SagaExecutor): inherited lock from 22cf7205-cd4f-4fad-a50b-a5b58405a44a to 3c84b08b-42e5-4f84-b10a-8c44c0d0489a actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 22cf7205-cd4f-4fad-a50b-a5b58405a44a saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = BecomeUpdater updater_id = 3c84b08b-42e5-4f84-b10a-8c44c0d0489a
75222024-10-01T02:39:59.315ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update
75232024-10-01T02:39:59.317ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75242024-10-01T02:39:59.317ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("3c84b08b-42e5-4f84-b10a-8c44c0d0489a")}) node_id = 1 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
75252024-10-01T02:39:59.323ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75262024-10-01T02:39:59.323ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
75272024-10-01T02:39:59.329ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75282024-10-01T02:39:59.329ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
75292024-10-01T02:39:59.336ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75302024-10-01T02:39:59.336ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
75312024-10-01T02:39:59.342ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update
75322024-10-01T02:39:59.346ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5
75332024-10-01T02:39:59.346ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = UpdateNetworkConfig
75342024-10-01T02:39:59.347ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = UpdateNetworkConfig
75352024-10-01T02:39:59.350ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = UpdateNetworkConfig
75362024-10-01T02:39:59.351ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = UpdateNetworkConfig
75372024-10-01T02:39:59.358ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
75382024-10-01T02:39:59.358ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = UpdateNetworkConfig
75392024-10-01T02:39:59.358ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = UpdateNetworkConfig
75402024-10-01T02:39:59.360ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
75412024-10-01T02:39:59.360ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
75422024-10-01T02:39:59.361ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
75432024-10-01T02:39:59.362ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
75442024-10-01T02:39:59.363ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
75452024-10-01T02:39:59.363ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
75462024-10-01T02:39:59.363ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
75472024-10-01T02:39:59.368ZDEBGnexus: notifying dendrite of updates instance_id = Some(155a6d94-b6d1-469e-afb5-9a278b60eab5 (instance)) switch = switch0
75482024-10-01T02:39:59.368ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1652, tv_nsec: 808621173 } })
75492024-10-01T02:39:59.369ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1051
75502024-10-01T02:39:59.399ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
75512024-10-01T02:39:59.399ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75522024-10-01T02:39:59.399ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "10e688a8-be5a-411f-9e28-f59b6ca1c9ea", "content-length": "26", "date": "Tue, 01 Oct 2024 02:39:59 GMT"} })
75532024-10-01T02:39:59.399ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75542024-10-01T02:39:59.400ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75552024-10-01T02:39:59.429ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
75562024-10-01T02:39:59.429ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "b26518c6-64d9-4ca4-8258-e41041874bbe", "content-length": "4", "date": "Tue, 01 Oct 2024 02:39:58 GMT"} })
75572024-10-01T02:39:59.429ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75582024-10-01T02:39:59.429ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
75592024-10-01T02:39:59.437ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75602024-10-01T02:39:59.437ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
75612024-10-01T02:39:59.444ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
75622024-10-01T02:39:59.444ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
75632024-10-01T02:39:59.465ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-10-01T02:39:59.447118Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, time_modified: Some(2024-10-01T02:39:59.447118Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: ade3b588-424d-4931-8c7d-7d3a43246cab, time_modified: Some(2024-10-01T02:39:59.447118Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update
75642024-10-01T02:39:59.465ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75652024-10-01T02:39:59.465ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
75662024-10-01T02:39:59.472ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75672024-10-01T02:39:59.473ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
75682024-10-01T02:39:59.479ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update
75692024-10-01T02:39:59.479ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = UnassignOximeterProducer
75702024-10-01T02:39:59.480ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = UnassignOximeterProducer
75712024-10-01T02:39:59.496ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 producer_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update
75722024-10-01T02:39:59.496ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = UnassignOximeterProducer
75732024-10-01T02:39:59.496ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = UnassignOximeterProducer
75742024-10-01T02:39:59.529ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update
75752024-10-01T02:39:59.529ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 155a6d94-b6d1-469e-afb5-9a278b60eab5 saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/155a6d94-b6d1-469e-afb5-9a278b60eab5
75762024-10-01T02:39:59.538ZDEBGnexus (SagaExecutor): client response oximeter-collector = 155a6d94-b6d1-469e-afb5-9a278b60eab5 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/155a6d94-b6d1-469e-afb5-9a278b60eab5", status: 204, headers: {"x-request-id": "47fcbe02-4856-41de-8cef-37e560b71220", "date": "Tue, 01 Oct 2024 02:39:59 GMT"} }) saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update
75772024-10-01T02:39:59.538ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 producer_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update
75782024-10-01T02:39:59.540ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75792024-10-01T02:39:59.540ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
75802024-10-01T02:39:59.545ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75812024-10-01T02:39:59.545ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
75822024-10-01T02:39:59.552ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 lock = UpdaterLock { updater_id: 3c84b08b-42e5-4f84-b10a-8c44c0d0489a, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-10-01T02:39:59.259073112Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update
75832024-10-01T02:39:59.552ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = CommitInstanceUpdates
75842024-10-01T02:39:59.552ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = CommitInstanceUpdates
75852024-10-01T02:39:59.593ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 new_runtime = InstanceRuntimeState { time_updated: 2024-10-01T02:39:59.259073112Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update
75862024-10-01T02:39:59.593ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75872024-10-01T02:39:59.593ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
75882024-10-01T02:39:59.593ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Signaled
75892024-10-01T02:39:59.593ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Signaled
75902024-10-01T02:39:59.593ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75912024-10-01T02:39:59.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75922024-10-01T02:39:59.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75932024-10-01T02:39:59.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75942024-10-01T02:39:59.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75952024-10-01T02:39:59.596ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75962024-10-01T02:39:59.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75972024-10-01T02:39:59.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75982024-10-01T02:39:59.597ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
75992024-10-01T02:39:59.597ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
76002024-10-01T02:39:59.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76012024-10-01T02:39:59.599ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76022024-10-01T02:39:59.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76032024-10-01T02:39:59.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76042024-10-01T02:39:59.603ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
76052024-10-01T02:39:59.603ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("155a6d94-b6d1-469e-afb5-9a278b60eab5"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("031b6427-1460-4676-a469-9de2f0f9317d")}) node_id = 7 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
76062024-10-01T02:39:59.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76072024-10-01T02:39:59.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76082024-10-01T02:39:59.608ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
76092024-10-01T02:39:59.608ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
76102024-10-01T02:39:59.615ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
76112024-10-01T02:39:59.615ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
76122024-10-01T02:39:59.619ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
76132024-10-01T02:39:59.619ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
76142024-10-01T02:39:59.633ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76152024-10-01T02:39:59.633ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee3157d3-43d5-4f02-a8b3-2dcbeb244850", "content-length": "372", "date": "Tue, 01 Oct 2024 02:39:59 GMT"} })
76162024-10-01T02:39:59.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76172024-10-01T02:39:59.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76182024-10-01T02:39:59.635ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76192024-10-01T02:39:59.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76202024-10-01T02:39:59.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76212024-10-01T02:39:59.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76222024-10-01T02:39:59.640ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76232024-10-01T02:39:59.641ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76242024-10-01T02:39:59.641ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6840a92b-068b-4b43-90af-f7d812665df4", "date": "Tue, 01 Oct 2024 02:39:59 GMT"} })
76252024-10-01T02:39:59.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76262024-10-01T02:39:59.642ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 48.672035ms iteration = 15 status = {}
76272024-10-01T02:39:59.642ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76282024-10-01T02:39:59.644ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76292024-10-01T02:39:59.644ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76302024-10-01T02:39:59.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76312024-10-01T02:39:59.645ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76322024-10-01T02:39:59.647ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76332024-10-01T02:39:59.647ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76342024-10-01T02:39:59.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76352024-10-01T02:39:59.651ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 propolis_id = 031b6427-1460-4676-a469-9de2f0f9317d saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update
76362024-10-01T02:39:59.651ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = ReleaseSledResources
76372024-10-01T02:39:59.651ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = ReleaseSledResources
76382024-10-01T02:39:59.678ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
76392024-10-01T02:39:59.678ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
76402024-10-01T02:39:59.684ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
76412024-10-01T02:39:59.684ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3956d17e-4d8c-4a52-a069-73c02abf020e", "content-length": "691", "date": "Tue, 01 Oct 2024 02:39:59 GMT"} })
76422024-10-01T02:39:59.685ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
76432024-10-01T02:39:59.685ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
76442024-10-01T02:39:59.685ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
76452024-10-01T02:39:59.685ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
76462024-10-01T02:39:59.685ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
76472024-10-01T02:39:59.686ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 92.964818ms iteration = 15 status = {}
76482024-10-01T02:39:59.691ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 propolis_id = 031b6427-1460-4676-a469-9de2f0f9317d saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update
76492024-10-01T02:39:59.691ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = MarkVmmDeleted
76502024-10-01T02:39:59.692ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = MarkVmmDeleted
76512024-10-01T02:39:59.710ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
76522024-10-01T02:39:59.710ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
76532024-10-01T02:39:59.720ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
76542024-10-01T02:39:59.720ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
76552024-10-01T02:39:59.724ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
76562024-10-01T02:39:59.724ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
76572024-10-01T02:39:59.731ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
76582024-10-01T02:39:59.731ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
76592024-10-01T02:39:59.736ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = ChainSuccessorSaga
76602024-10-01T02:39:59.736ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = ChainSuccessorSaga
76612024-10-01T02:39:59.737ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = ChainSuccessorSaga
76622024-10-01T02:39:59.738ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = ChainSuccessorSaga
76632024-10-01T02:39:59.739ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = ChainSuccessorSaga
76642024-10-01T02:39:59.739ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = ChainSuccessorSaga
76652024-10-01T02:39:59.740ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = ChainSuccessorSaga
76662024-10-01T02:39:59.743ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: ade3b588-424d-4931-8c7d-7d3a43246cab, lookup_type: ById(ade3b588-424d-4931-8c7d-7d3a43246cab) }, key: 155a6d94-b6d1-469e-afb5-9a278b60eab5, lookup_type: ById(155a6d94-b6d1-469e-afb5-9a278b60eab5) } result = Ok(()) saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = ChainSuccessorSaga
76672024-10-01T02:39:59.743ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = ChainSuccessorSaga
76682024-10-01T02:39:59.743ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_node = ChainSuccessorSaga
76692024-10-01T02:39:59.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0f31e118-360a-4186-91ac-ff6703a2e222 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
76702024-10-01T02:39:59.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0f31e118-360a-4186-91ac-ff6703a2e222 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
76712024-10-01T02:39:59.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1922 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0f31e118-360a-4186-91ac-ff6703a2e222 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
76722024-10-01T02:39:59.783ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update
76732024-10-01T02:39:59.783ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
76742024-10-01T02:39:59.783ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
76752024-10-01T02:39:59.783ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Signaled
76762024-10-01T02:39:59.783ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76772024-10-01T02:39:59.783ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76782024-10-01T02:39:59.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76792024-10-01T02:39:59.786ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76802024-10-01T02:39:59.786ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
76812024-10-01T02:39:59.786ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76822024-10-01T02:39:59.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76832024-10-01T02:39:59.788ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76842024-10-01T02:39:59.788ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76852024-10-01T02:39:59.788ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76862024-10-01T02:39:59.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76872024-10-01T02:39:59.788ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
76882024-10-01T02:39:59.789ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
76892024-10-01T02:39:59.799ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
76902024-10-01T02:39:59.799ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 18f58866-7643-4cb8-8864-8667960ba072
76912024-10-01T02:39:59.806ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 18f58866-7643-4cb8-8864-8667960ba072 sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
76922024-10-01T02:39:59.806ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 18f58866-7643-4cb8-8864-8667960ba072
76932024-10-01T02:39:59.816ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76942024-10-01T02:39:59.816ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
76952024-10-01T02:39:59.816ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 32.993493ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
76962024-10-01T02:39:59.849ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
76972024-10-01T02:39:59.849ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 18f58866-7643-4cb8-8864-8667960ba072 saga_name = instance-update saga_result = SagaResult { saga_id: 18f58866-7643-4cb8-8864-8667960ba072, saga_log: SagaLog { saga_id: 18f58866-7643-4cb8-8864-8667960ba072, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("3c84b08b-42e5-4f84-b10a-8c44c0d0489a")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("3c84b08b-42e5-4f84-b10a-8c44c0d0489a")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("155a6d94-b6d1-469e-afb5-9a278b60eab5"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("031b6427-1460-4676-a469-9de2f0f9317d")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("155a6d94-b6d1-469e-afb5-9a278b60eab5"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("031b6427-1460-4676-a469-9de2f0f9317d")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("3c84b08b-42e5-4f84-b10a-8c44c0d0489a"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("3c84b08b-42e5-4f84-b10a-8c44c0d0489a")}} }) }
76982024-10-01T02:39:59.849ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 18f58866-7643-4cb8-8864-8667960ba072 instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update
76992024-10-01T02:39:59.849ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
77002024-10-01T02:39:59.849ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b
77012024-10-01T02:39:59.857ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
77022024-10-01T02:39:59.857ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b
77032024-10-01T02:39:59.861ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
77042024-10-01T02:39:59.861ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b
77052024-10-01T02:39:59.867ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
77062024-10-01T02:39:59.867ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b
77072024-10-01T02:39:59.914ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update sec_id = 772acfa5-ee20-4a17-a053-c207ffa50ed6
77082024-10-01T02:39:59.914ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = ee3cec33-f155-454a-9665-aa34b56b7d5b saga_name = start-instance-update saga_result = SagaResult { saga_id: ee3cec33-f155-454a-9665-aa34b56b7d5b, saga_log: SagaLog { saga_id: ee3cec33-f155-454a-9665-aa34b56b7d5b, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("22cf7205-cd4f-4fad-a50b-a5b58405a44a")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("22cf7205-cd4f-4fad-a50b-a5b58405a44a")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("22cf7205-cd4f-4fad-a50b-a5b58405a44a"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("22cf7205-cd4f-4fad-a50b-a5b58405a44a")}} }) }
77092024-10-01T02:40:00.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cbb51fdc-6a00-436b-acdd-0017b6781595 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77102024-10-01T02:40:00.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cbb51fdc-6a00-436b-acdd-0017b6781595 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77112024-10-01T02:40:00.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1768 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cbb51fdc-6a00-436b-acdd-0017b6781595 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77122024-10-01T02:40:01.035ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
77132024-10-01T02:40:01.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77142024-10-01T02:40:01.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77152024-10-01T02:40:01.035ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
77162024-10-01T02:40:01.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77172024-10-01T02:40:01.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77182024-10-01T02:40:01.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77192024-10-01T02:40:01.037ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77202024-10-01T02:40:01.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77212024-10-01T02:40:01.038ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.163853ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77222024-10-01T02:40:01.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77232024-10-01T02:40:01.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77242024-10-01T02:40:01.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77252024-10-01T02:40:01.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77262024-10-01T02:40:01.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77272024-10-01T02:40:01.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77282024-10-01T02:40:01.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
77292024-10-01T02:40:01.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77302024-10-01T02:40:01.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77312024-10-01T02:40:01.053ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
77322024-10-01T02:40:01.053ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.089143ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
77332024-10-01T02:40:01.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e1e5e799-2cc9-437b-9991-d005c1913cae roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77342024-10-01T02:40:01.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e1e5e799-2cc9-437b-9991-d005c1913cae resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77352024-10-01T02:40:01.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e1e5e799-2cc9-437b-9991-d005c1913cae response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77362024-10-01T02:40:01.871ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 496 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 0f8954c5-236f-45e5-bec2-8aeaf9857f50 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
77372024-10-01T02:40:02.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8ac0b832-2720-4639-b570-da307aba2aed roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77382024-10-01T02:40:02.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8ac0b832-2720-4639-b570-da307aba2aed resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77392024-10-01T02:40:02.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8ac0b832-2720-4639-b570-da307aba2aed response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77402024-10-01T02:40:03.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6980a9ad-c773-4423-99ad-f664d0a86eb2 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77412024-10-01T02:40:03.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6980a9ad-c773-4423-99ad-f664d0a86eb2 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77422024-10-01T02:40:03.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6980a9ad-c773-4423-99ad-f664d0a86eb2 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77432024-10-01T02:40:04.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6e78d458-36ff-465f-8cd8-0b2101b3b2e4 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77442024-10-01T02:40:04.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6e78d458-36ff-465f-8cd8-0b2101b3b2e4 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77452024-10-01T02:40:04.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6e78d458-36ff-465f-8cd8-0b2101b3b2e4 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77462024-10-01T02:40:05.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 733382a4-0b0b-4fe3-89a7-34b29a1b8e56 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77472024-10-01T02:40:05.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 733382a4-0b0b-4fe3-89a7-34b29a1b8e56 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77482024-10-01T02:40:05.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 733382a4-0b0b-4fe3-89a7-34b29a1b8e56 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77492024-10-01T02:40:06.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 049a0e6b-6b35-4030-8bab-d1ece44497a3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77502024-10-01T02:40:06.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 049a0e6b-6b35-4030-8bab-d1ece44497a3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77512024-10-01T02:40:06.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 049a0e6b-6b35-4030-8bab-d1ece44497a3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77522024-10-01T02:40:07.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ef98b504-7a4c-429a-bc68-c8fda63d8352 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77532024-10-01T02:40:07.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ef98b504-7a4c-429a-bc68-c8fda63d8352 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77542024-10-01T02:40:07.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2810 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ef98b504-7a4c-429a-bc68-c8fda63d8352 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77552024-10-01T02:40:08.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c8c9f0ff-110c-43d2-b480-c481c7870b57 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77562024-10-01T02:40:08.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c8c9f0ff-110c-43d2-b480-c481c7870b57 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77572024-10-01T02:40:08.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c8c9f0ff-110c-43d2-b480-c481c7870b57 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77582024-10-01T02:40:10.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e0c25815-3d5e-4e5a-bde1-9dfc39732ab0 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77592024-10-01T02:40:10.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e0c25815-3d5e-4e5a-bde1-9dfc39732ab0 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77602024-10-01T02:40:10.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e0c25815-3d5e-4e5a-bde1-9dfc39732ab0 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77612024-10-01T02:40:11.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = da0c0ecc-5423-475b-a479-55dd10adc8f7 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77622024-10-01T02:40:11.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = da0c0ecc-5423-475b-a479-55dd10adc8f7 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77632024-10-01T02:40:11.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = da0c0ecc-5423-475b-a479-55dd10adc8f7 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
77642024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
77652024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
77662024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77672024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
77682024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
77692024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
77702024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
77712024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77722024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
77732024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
77742024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77752024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
77762024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
77772024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
77782024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
77792024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77802024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
77812024-10-01T02:40:11.034ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07
77822024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.601\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07"}
77832024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
77842024-10-01T02:40:11.034ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-01 02:30:11.034554161 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
77852024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
77862024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
77872024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
77882024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77892024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77902024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
77912024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77922024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77932024-10-01T02:40:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77942024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
77952024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77962024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
77972024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
77982024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77992024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78002024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
78012024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78022024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
78032024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
78042024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
78052024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78062024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
78072024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
78082024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
78092024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
78102024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
78112024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
78122024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
78132024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78142024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
78152024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78162024-10-01T02:40:11.035ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
78172024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
78182024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
78192024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
78202024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78212024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
78222024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
78232024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
78242024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
78252024-10-01T02:40:11.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78262024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
78272024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
78282024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78292024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78302024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
78312024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78322024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78332024-10-01T02:40:11.036ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1664, tv_nsec: 475830270 } })
78342024-10-01T02:40:11.036ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1664, tv_nsec: 475860160 } })
78352024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78362024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78372024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
78382024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
78392024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78402024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
78412024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
78422024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78432024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78442024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
78452024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
78462024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78472024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78482024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78492024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78502024-10-01T02:40:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78512024-10-01T02:40:11.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78522024-10-01T02:40:11.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78532024-10-01T02:40:11.037ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78542024-10-01T02:40:11.038ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
78552024-10-01T02:40:11.038ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.058118ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
78562024-10-01T02:40:11.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78572024-10-01T02:40:11.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78582024-10-01T02:40:11.038ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.604217ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
78592024-10-01T02:40:11.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78602024-10-01T02:40:11.039ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
78612024-10-01T02:40:11.039ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.747519ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
78622024-10-01T02:40:11.039ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1664, tv_nsec: 479108825 } })
78632024-10-01T02:40:11.039ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1664, tv_nsec: 479143575 } })
78642024-10-01T02:40:11.039ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-01 02:30:11.034554161 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
78652024-10-01T02:40:11.039ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.314519ms iteration = 8 status = {"expiration":"2024-10-01T02:30:11.034554161Z","pruned":[]}
78662024-10-01T02:40:11.039ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
78672024-10-01T02:40:11.039ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
78682024-10-01T02:40:11.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78692024-10-01T02:40:11.039ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78702024-10-01T02:40:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78712024-10-01T02:40:11.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78722024-10-01T02:40:11.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78732024-10-01T02:40:11.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78742024-10-01T02:40:11.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78752024-10-01T02:40:11.044ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.673625ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
78762024-10-01T02:40:11.044ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78772024-10-01T02:40:11.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78782024-10-01T02:40:11.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78792024-10-01T02:40:11.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78802024-10-01T02:40:11.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78812024-10-01T02:40:11.045ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78822024-10-01T02:40:11.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78832024-10-01T02:40:11.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78842024-10-01T02:40:11.048ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78852024-10-01T02:40:11.048ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
78862024-10-01T02:40:11.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78872024-10-01T02:40:11.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78882024-10-01T02:40:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
78892024-10-01T02:40:11.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78902024-10-01T02:40:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78912024-10-01T02:40:11.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78922024-10-01T02:40:11.054ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78932024-10-01T02:40:11.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
78942024-10-01T02:40:11.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78952024-10-01T02:40:11.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78962024-10-01T02:40:11.055ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78972024-10-01T02:40:11.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78982024-10-01T02:40:11.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78992024-10-01T02:40:11.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79002024-10-01T02:40:11.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79012024-10-01T02:40:11.057ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.479399ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79022024-10-01T02:40:11.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79032024-10-01T02:40:11.058ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79042024-10-01T02:40:11.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79052024-10-01T02:40:11.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79062024-10-01T02:40:11.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79072024-10-01T02:40:11.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79082024-10-01T02:40:11.068ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79092024-10-01T02:40:11.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79102024-10-01T02:40:11.072ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1664, tv_nsec: 512580836 } })
79112024-10-01T02:40:11.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
79122024-10-01T02:40:11.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79132024-10-01T02:40:11.073ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
79142024-10-01T02:40:11.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79152024-10-01T02:40:11.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
79162024-10-01T02:40:11.074ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79172024-10-01T02:40:11.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79182024-10-01T02:40:11.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79192024-10-01T02:40:11.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79202024-10-01T02:40:11.087ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79212024-10-01T02:40:11.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
79222024-10-01T02:40:11.090ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
79232024-10-01T02:40:11.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
79242024-10-01T02:40:11.093ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
79252024-10-01T02:40:11.093ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.291636ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
79262024-10-01T02:40:11.105ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.447774ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
79272024-10-01T02:40:11.105ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
79282024-10-01T02:40:11.105ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
79292024-10-01T02:40:11.105ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.77724ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
79302024-10-01T02:40:11.106ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.204976ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
79312024-10-01T02:40:11.107ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79322024-10-01T02:40:11.107ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79332024-10-01T02:40:11.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79342024-10-01T02:40:11.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79352024-10-01T02:40:11.109ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79362024-10-01T02:40:11.109ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79372024-10-01T02:40:11.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79382024-10-01T02:40:11.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
79392024-10-01T02:40:11.112ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79402024-10-01T02:40:11.112ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 76.477202ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
79412024-10-01T02:40:11.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79422024-10-01T02:40:11.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79432024-10-01T02:40:11.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79442024-10-01T02:40:11.117ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79452024-10-01T02:40:11.118ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
79462024-10-01T02:40:11.118ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79472024-10-01T02:40:11.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79482024-10-01T02:40:11.124ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79492024-10-01T02:40:11.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79502024-10-01T02:40:11.125ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
79512024-10-01T02:40:11.125ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
79522024-10-01T02:40:11.125ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
79532024-10-01T02:40:11.125ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79542024-10-01T02:40:11.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79552024-10-01T02:40:11.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79562024-10-01T02:40:11.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79572024-10-01T02:40:11.149ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
79582024-10-01T02:40:11.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
79592024-10-01T02:40:11.153ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
79602024-10-01T02:40:11.153ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
79612024-10-01T02:40:11.153ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
79622024-10-01T02:40:11.153ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79632024-10-01T02:40:11.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79642024-10-01T02:40:11.200ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
79652024-10-01T02:40:11.201ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79662024-10-01T02:40:11.201ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "950b8d1e-2535-4e22-bb4e-ba1ff0988e51", "content-length": "26", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
79672024-10-01T02:40:11.201ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79682024-10-01T02:40:11.202ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
79692024-10-01T02:40:11.202ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79702024-10-01T02:40:11.229ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
79712024-10-01T02:40:11.229ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79722024-10-01T02:40:11.229ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "12ffe6bf-29e4-4c4c-a1b0-91b2e0543ea8", "content-length": "26", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
79732024-10-01T02:40:11.229ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79742024-10-01T02:40:11.231ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79752024-10-01T02:40:11.241ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
79762024-10-01T02:40:11.241ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79772024-10-01T02:40:11.241ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c52a7ef-6664-4e72-b28f-ca075faf64c2", "content-length": "26", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
79782024-10-01T02:40:11.241ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79792024-10-01T02:40:11.243ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
79802024-10-01T02:40:11.262ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
79812024-10-01T02:40:11.384ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79822024-10-01T02:40:11.384ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "afe8f6b8-5469-436f-a158-3899d9af5e65", "content-length": "372", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
79832024-10-01T02:40:11.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79842024-10-01T02:40:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79852024-10-01T02:40:11.389ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79862024-10-01T02:40:11.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79872024-10-01T02:40:11.390ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79882024-10-01T02:40:11.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79892024-10-01T02:40:11.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79902024-10-01T02:40:11.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79912024-10-01T02:40:11.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79922024-10-01T02:40:11.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79932024-10-01T02:40:11.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79942024-10-01T02:40:11.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79952024-10-01T02:40:11.394ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79962024-10-01T02:40:11.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79972024-10-01T02:40:11.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79982024-10-01T02:40:11.400ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79992024-10-01T02:40:11.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80002024-10-01T02:40:11.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
80012024-10-01T02:40:11.403ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80022024-10-01T02:40:11.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80032024-10-01T02:40:11.405ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80042024-10-01T02:40:11.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80052024-10-01T02:40:11.406ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 370.285525ms iteration = 15 status = 0
80062024-10-01T02:40:11.409ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80072024-10-01T02:40:11.410ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fa8ea135-2b06-476a-a70c-fdcd4e9fcd16", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
80082024-10-01T02:40:11.412ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 376.55848ms iteration = 16 status = {}
80092024-10-01T02:40:11.414ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 379.694812ms iteration = 15 status = {}
80102024-10-01T02:40:11.418ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80112024-10-01T02:40:11.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80122024-10-01T02:40:11.424ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
80132024-10-01T02:40:11.424ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 388.688143ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
80142024-10-01T02:40:11.424ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 389.155791ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80152024-10-01T02:40:11.429ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
80162024-10-01T02:40:11.429ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 0 version = 2
80172024-10-01T02:40:11.429ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80182024-10-01T02:40:11.429ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80192024-10-01T02:40:11.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80202024-10-01T02:40:11.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80212024-10-01T02:40:11.431ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80222024-10-01T02:40:11.431ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80232024-10-01T02:40:11.432ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
80242024-10-01T02:40:11.432ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
80252024-10-01T02:40:11.432ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 396.320911ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
80262024-10-01T02:40:11.434ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
80272024-10-01T02:40:11.434ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80282024-10-01T02:40:11.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80292024-10-01T02:40:11.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
80302024-10-01T02:40:11.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80312024-10-01T02:40:11.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80322024-10-01T02:40:11.436ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80332024-10-01T02:40:11.436ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
80342024-10-01T02:40:11.436ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 400.634003ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
80352024-10-01T02:40:11.438ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 1 version = 2
80362024-10-01T02:40:11.438ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
80372024-10-01T02:40:11.438ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-01 02:33:13.765844 UTC dns_group = external generation = 2
80382024-10-01T02:40:11.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 404.466547ms iteration = 8 status = {"generation":2}
80392024-10-01T02:40:11.439ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80402024-10-01T02:40:11.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80412024-10-01T02:40:11.441ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80422024-10-01T02:40:11.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80432024-10-01T02:40:11.455ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
80442024-10-01T02:40:11.455ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
80452024-10-01T02:40:11.455ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80462024-10-01T02:40:11.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80472024-10-01T02:40:11.458ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 422.377228ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
80482024-10-01T02:40:11.459ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80492024-10-01T02:40:11.462ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
80502024-10-01T02:40:11.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80512024-10-01T02:40:11.463ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80522024-10-01T02:40:11.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80532024-10-01T02:40:11.466ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
80542024-10-01T02:40:11.466ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
80552024-10-01T02:40:11.466ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-01 02:33:12.369795 UTC dns_group = internal generation = 1
80562024-10-01T02:40:11.466ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 432.09709ms iteration = 8 status = {"generation":1}
80572024-10-01T02:40:11.491ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-01T02:33:09.142901Z, time_modified: 2024-10-01T02:33:09.142901Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
80582024-10-01T02:40:11.491ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 457.288883ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]}},"default_endpoint":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
80592024-10-01T02:40:11.492ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
80602024-10-01T02:40:11.492ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 457.051329ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
80612024-10-01T02:40:11.500ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80622024-10-01T02:40:11.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80632024-10-01T02:40:11.502ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80642024-10-01T02:40:11.504ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
80652024-10-01T02:40:11.504ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80662024-10-01T02:40:11.504ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80672024-10-01T02:40:11.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80682024-10-01T02:40:11.505ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "81bac9b1-0da5-4293-9f72-00eeb14cb505", "content-length": "2", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
80692024-10-01T02:40:11.508ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80702024-10-01T02:40:11.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80712024-10-01T02:40:11.511ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 477.203707ms iteration = 15 status = null
80722024-10-01T02:40:11.515ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
80732024-10-01T02:40:11.515ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0c12ba63-9a21-4e9c-ae9b-1dc6f1e05bcc", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80742024-10-01T02:40:11.515ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80752024-10-01T02:40:11.518ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5e0affd6-af60-4f59-9365-94c2aacb82d4", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80762024-10-01T02:40:11.518ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80772024-10-01T02:40:11.521ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80782024-10-01T02:40:11.521ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 487.073712ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
80792024-10-01T02:40:11.554ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80802024-10-01T02:40:11.557ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80812024-10-01T02:40:11.557ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80822024-10-01T02:40:11.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80832024-10-01T02:40:11.572ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
80842024-10-01T02:40:11.572ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "99c1a1fb-6980-414e-bbf8-f8e869ab14a8", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
80852024-10-01T02:40:11.572ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
80862024-10-01T02:40:11.574ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b2850f2f-e284-4175-9e0a-7a9bdd98f70a", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
80872024-10-01T02:40:11.574ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
80882024-10-01T02:40:11.579ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "071cae3a-cb4a-4f2c-a265-4e2d721d5834", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
80892024-10-01T02:40:11.579ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
80902024-10-01T02:40:11.581ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
80912024-10-01T02:40:11.581ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 547.149099ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
80922024-10-01T02:40:11.582ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 546.734221ms iteration = 17 status = {"physical_disks_added":0}
80932024-10-01T02:40:11.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80942024-10-01T02:40:11.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80952024-10-01T02:40:11.606ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
80962024-10-01T02:40:11.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80972024-10-01T02:40:11.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80982024-10-01T02:40:11.616ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
80992024-10-01T02:40:11.617ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0697348-8155-48dc-9949-7f4dc0aecac5", "content-length": "121", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
81002024-10-01T02:40:11.617ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
81012024-10-01T02:40:11.617ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
81022024-10-01T02:40:11.617ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
81032024-10-01T02:40:11.617ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
81042024-10-01T02:40:11.617ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
81052024-10-01T02:40:11.617ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
81062024-10-01T02:40:11.617ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
81072024-10-01T02:40:11.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81082024-10-01T02:40:11.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81092024-10-01T02:40:11.619ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
81102024-10-01T02:40:11.619ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8212c39a-67e2-4fe5-88fa-5a7e4df8029f", "content-length": "2", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
81112024-10-01T02:40:11.620ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81122024-10-01T02:40:11.620ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "840c563b-450b-49e6-9d4b-d9cf05a07c95", "content-length": "52", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
81132024-10-01T02:40:11.620ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
81142024-10-01T02:40:11.620ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81152024-10-01T02:40:11.628ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81162024-10-01T02:40:11.735ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4207d51f-4a8c-4116-9fe9-38b5bfadc058", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
81172024-10-01T02:40:11.735ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
81182024-10-01T02:40:11.735ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81192024-10-01T02:40:11.735ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "93b6d154-531c-4e2e-82b5-b5e5f40d8ffe", "content-length": "667", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
81202024-10-01T02:40:11.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81212024-10-01T02:40:11.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81222024-10-01T02:40:11.736ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e93bb870-ed3c-41ae-add6-9091462ecf35", "content-length": "691", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
81232024-10-01T02:40:11.736ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
81242024-10-01T02:40:11.736ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
81252024-10-01T02:40:11.736ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
81262024-10-01T02:40:11.738ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 702.387619ms iteration = 16 status = {}
81272024-10-01T02:40:11.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81282024-10-01T02:40:11.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81292024-10-01T02:40:11.743ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81302024-10-01T02:40:11.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81312024-10-01T02:40:11.746ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81322024-10-01T02:40:11.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81332024-10-01T02:40:11.753ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 717.465623ms iteration = 15 status = {}
81342024-10-01T02:40:11.871ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 501 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 254c2ef9-cc8f-4fbd-a565-37b5676c67b0 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
81352024-10-01T02:40:12.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c503facf-8af1-42d3-901c-d2110ca08e83 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81362024-10-01T02:40:12.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c503facf-8af1-42d3-901c-d2110ca08e83 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81372024-10-01T02:40:12.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c503facf-8af1-42d3-901c-d2110ca08e83 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81382024-10-01T02:40:13.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1881b44b-b524-4f0e-92c1-078c302fead8 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81392024-10-01T02:40:13.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1881b44b-b524-4f0e-92c1-078c302fead8 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81402024-10-01T02:40:13.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1881b44b-b524-4f0e-92c1-078c302fead8 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81412024-10-01T02:40:14.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e15ed908-8e05-41c0-9857-038596b40445 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81422024-10-01T02:40:14.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e15ed908-8e05-41c0-9857-038596b40445 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81432024-10-01T02:40:14.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e15ed908-8e05-41c0-9857-038596b40445 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81442024-10-01T02:40:15.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5325f7f4-faa5-4b6d-9167-f109de5e18df roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81452024-10-01T02:40:15.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5325f7f4-faa5-4b6d-9167-f109de5e18df resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81462024-10-01T02:40:15.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5325f7f4-faa5-4b6d-9167-f109de5e18df response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81472024-10-01T02:40:16.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 91c98e80-50f7-4e53-a182-33ba2ed0a8bb roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81482024-10-01T02:40:16.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 91c98e80-50f7-4e53-a182-33ba2ed0a8bb resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81492024-10-01T02:40:16.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2796 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 91c98e80-50f7-4e53-a182-33ba2ed0a8bb response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81502024-10-01T02:40:17.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c215fabc-ea86-480b-a9ae-b0b909c72f60 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81512024-10-01T02:40:17.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c215fabc-ea86-480b-a9ae-b0b909c72f60 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81522024-10-01T02:40:17.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2095 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c215fabc-ea86-480b-a9ae-b0b909c72f60 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81532024-10-01T02:40:18.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0c2fd28c-6ca6-4e74-872f-dfe9ad3254f0 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81542024-10-01T02:40:18.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0c2fd28c-6ca6-4e74-872f-dfe9ad3254f0 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81552024-10-01T02:40:18.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2864 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0c2fd28c-6ca6-4e74-872f-dfe9ad3254f0 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81562024-10-01T02:40:19.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c1198855-df10-4426-8938-ec8e3d0bc837 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81572024-10-01T02:40:19.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c1198855-df10-4426-8938-ec8e3d0bc837 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81582024-10-01T02:40:19.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2608 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c1198855-df10-4426-8938-ec8e3d0bc837 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81592024-10-01T02:40:20.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7cb15570-426b-48b0-9995-95152b31f69b roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81602024-10-01T02:40:20.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7cb15570-426b-48b0-9995-95152b31f69b resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81612024-10-01T02:40:20.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7cb15570-426b-48b0-9995-95152b31f69b response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81622024-10-01T02:40:21.034ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
81632024-10-01T02:40:21.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81642024-10-01T02:40:21.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81652024-10-01T02:40:21.036ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
81662024-10-01T02:40:21.036ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81672024-10-01T02:40:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81682024-10-01T02:40:21.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81692024-10-01T02:40:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81702024-10-01T02:40:21.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81712024-10-01T02:40:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81722024-10-01T02:40:21.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81732024-10-01T02:40:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81742024-10-01T02:40:21.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81752024-10-01T02:40:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81762024-10-01T02:40:21.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81772024-10-01T02:40:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
81782024-10-01T02:40:21.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81792024-10-01T02:40:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81802024-10-01T02:40:21.077ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
81812024-10-01T02:40:21.077ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.97268ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
81822024-10-01T02:40:21.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.502001ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81832024-10-01T02:40:21.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 09eb8b78-38ed-4806-8056-3e898a098519 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81842024-10-01T02:40:21.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 09eb8b78-38ed-4806-8056-3e898a098519 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81852024-10-01T02:40:21.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1844 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 09eb8b78-38ed-4806-8056-3e898a098519 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81862024-10-01T02:40:21.872ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1156 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 10343f90-d37e-4dcd-b49e-aa513e8b986a response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
81872024-10-01T02:40:22.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 90507d31-7d21-490b-8ab4-50d7124cd893 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81882024-10-01T02:40:22.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 90507d31-7d21-490b-8ab4-50d7124cd893 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81892024-10-01T02:40:22.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 90507d31-7d21-490b-8ab4-50d7124cd893 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81902024-10-01T02:40:23.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c928b04d-b7bd-417e-9f40-01c5d8a5110f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81912024-10-01T02:40:23.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c928b04d-b7bd-417e-9f40-01c5d8a5110f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81922024-10-01T02:40:23.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = c928b04d-b7bd-417e-9f40-01c5d8a5110f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81932024-10-01T02:40:24.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 688a3ddf-f7ec-4e7d-bc86-7d4be27aca35 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81942024-10-01T02:40:24.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 688a3ddf-f7ec-4e7d-bc86-7d4be27aca35 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81952024-10-01T02:40:24.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 688a3ddf-f7ec-4e7d-bc86-7d4be27aca35 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81962024-10-01T02:40:25.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1dd1e3a3-2e6c-4c2f-98d8-e7dd56834e66 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81972024-10-01T02:40:25.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1dd1e3a3-2e6c-4c2f-98d8-e7dd56834e66 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81982024-10-01T02:40:25.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1dd1e3a3-2e6c-4c2f-98d8-e7dd56834e66 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
81992024-10-01T02:40:26.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d9673050-35cf-4f3f-8c33-3a013ad66e00 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82002024-10-01T02:40:26.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d9673050-35cf-4f3f-8c33-3a013ad66e00 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82012024-10-01T02:40:26.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1837 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = d9673050-35cf-4f3f-8c33-3a013ad66e00 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82022024-10-01T02:40:27.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 58efc6f8-acda-4b5c-92f2-38bd67a037f2 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82032024-10-01T02:40:27.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 58efc6f8-acda-4b5c-92f2-38bd67a037f2 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82042024-10-01T02:40:27.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2845 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 58efc6f8-acda-4b5c-92f2-38bd67a037f2 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82052024-10-01T02:40:28.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 708adad2-d243-4e28-8381-ce8af88071fd roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82062024-10-01T02:40:28.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 708adad2-d243-4e28-8381-ce8af88071fd resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82072024-10-01T02:40:28.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 708adad2-d243-4e28-8381-ce8af88071fd response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82082024-10-01T02:40:29.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f2925ebd-cf30-4d9e-96fc-33a1f10bc17d roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82092024-10-01T02:40:29.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f2925ebd-cf30-4d9e-96fc-33a1f10bc17d resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82102024-10-01T02:40:29.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f2925ebd-cf30-4d9e-96fc-33a1f10bc17d response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82112024-10-01T02:40:30.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ef6d23e6-1987-4be1-a392-649496ef5a1c roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82122024-10-01T02:40:30.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ef6d23e6-1987-4be1-a392-649496ef5a1c resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82132024-10-01T02:40:30.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2584 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ef6d23e6-1987-4be1-a392-649496ef5a1c response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82142024-10-01T02:40:31.034ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
82152024-10-01T02:40:31.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82162024-10-01T02:40:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82172024-10-01T02:40:31.035ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
82182024-10-01T02:40:31.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82192024-10-01T02:40:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82202024-10-01T02:40:31.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82212024-10-01T02:40:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82222024-10-01T02:40:31.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82232024-10-01T02:40:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82242024-10-01T02:40:31.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82252024-10-01T02:40:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82262024-10-01T02:40:31.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82272024-10-01T02:40:31.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82282024-10-01T02:40:31.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82292024-10-01T02:40:31.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
82302024-10-01T02:40:31.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82312024-10-01T02:40:31.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82322024-10-01T02:40:31.088ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
82332024-10-01T02:40:31.088ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.73597ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
82342024-10-01T02:40:31.095ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.403436ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82352024-10-01T02:40:31.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 14cfbfd9-e7d8-46bf-9032-678ff1dc28f3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82362024-10-01T02:40:31.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 14cfbfd9-e7d8-46bf-9032-678ff1dc28f3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82372024-10-01T02:40:31.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 14cfbfd9-e7d8-46bf-9032-678ff1dc28f3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82382024-10-01T02:40:31.871ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 729 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = ca62c8b2-7ba5-46b2-8226-c9635641ae29 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
82392024-10-01T02:40:32.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 08064650-32af-4079-8355-8e5ee5c3574e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82402024-10-01T02:40:32.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 08064650-32af-4079-8355-8e5ee5c3574e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82412024-10-01T02:40:32.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 08064650-32af-4079-8355-8e5ee5c3574e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82422024-10-01T02:40:33.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ddaf828c-9350-4c17-93b3-b7cb6280fd91 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82432024-10-01T02:40:33.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ddaf828c-9350-4c17-93b3-b7cb6280fd91 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82442024-10-01T02:40:33.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ddaf828c-9350-4c17-93b3-b7cb6280fd91 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82452024-10-01T02:40:34.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1dc007f3-fa9e-42f6-8a00-ee2b817f305c roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82462024-10-01T02:40:34.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1dc007f3-fa9e-42f6-8a00-ee2b817f305c resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82472024-10-01T02:40:34.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 1dc007f3-fa9e-42f6-8a00-ee2b817f305c response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82482024-10-01T02:40:35.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ebb8369e-7b0f-4aaf-bf7c-929cbf5da3e3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82492024-10-01T02:40:35.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ebb8369e-7b0f-4aaf-bf7c-929cbf5da3e3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82502024-10-01T02:40:35.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1810 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ebb8369e-7b0f-4aaf-bf7c-929cbf5da3e3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82512024-10-01T02:40:36.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fb037555-e35c-4cea-95a0-b4b6d3533a8a roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82522024-10-01T02:40:36.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fb037555-e35c-4cea-95a0-b4b6d3533a8a resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82532024-10-01T02:40:36.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fb037555-e35c-4cea-95a0-b4b6d3533a8a response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82542024-10-01T02:40:37.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e2e84a42-1f70-403c-b55d-73c9eb68dd9a roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82552024-10-01T02:40:37.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e2e84a42-1f70-403c-b55d-73c9eb68dd9a resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82562024-10-01T02:40:37.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = e2e84a42-1f70-403c-b55d-73c9eb68dd9a response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82572024-10-01T02:40:38.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cf3eb8c6-d9b1-4a3b-8ab3-c00f95ac64dd roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82582024-10-01T02:40:38.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cf3eb8c6-d9b1-4a3b-8ab3-c00f95ac64dd resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82592024-10-01T02:40:38.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2302 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = cf3eb8c6-d9b1-4a3b-8ab3-c00f95ac64dd response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82602024-10-01T02:40:39.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ff181fe6-0121-4125-855e-6227d6e34b62 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82612024-10-01T02:40:39.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ff181fe6-0121-4125-855e-6227d6e34b62 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82622024-10-01T02:40:39.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = ff181fe6-0121-4125-855e-6227d6e34b62 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82632024-10-01T02:40:40.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6ed7524d-e059-4b5b-a033-c90253c50f7a roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82642024-10-01T02:40:40.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6ed7524d-e059-4b5b-a033-c90253c50f7a resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82652024-10-01T02:40:40.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6ed7524d-e059-4b5b-a033-c90253c50f7a response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
82662024-10-01T02:40:41.035ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
82672024-10-01T02:40:41.035ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
82682024-10-01T02:40:41.035ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82692024-10-01T02:40:41.035ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82702024-10-01T02:40:41.035ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
82712024-10-01T02:40:41.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82722024-10-01T02:40:41.035ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
82732024-10-01T02:40:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82742024-10-01T02:40:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82752024-10-01T02:40:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
82762024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
82772024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
82782024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
82792024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
82802024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82812024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
82822024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82832024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82842024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
82852024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82862024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
82872024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82882024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
82892024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
82902024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
82912024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82922024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
82932024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82942024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
82952024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82962024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
82972024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82982024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
82992024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
83002024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
83012024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83022024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83032024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
83042024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83052024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83062024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83072024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
83082024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83092024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83102024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83112024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83122024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83132024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83142024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83152024-10-01T02:40:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83162024-10-01T02:40:41.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83172024-10-01T02:40:41.038ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1694, tv_nsec: 478190409 } })
83182024-10-01T02:40:41.039ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.755246ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
83192024-10-01T02:40:41.039ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
83202024-10-01T02:40:41.039ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83212024-10-01T02:40:41.039ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.508815ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83222024-10-01T02:40:41.039ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1694, tv_nsec: 479287468 } })
83232024-10-01T02:40:41.040ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
83242024-10-01T02:40:41.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83252024-10-01T02:40:41.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83262024-10-01T02:40:41.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83272024-10-01T02:40:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
83282024-10-01T02:40:41.041ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83292024-10-01T02:40:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83302024-10-01T02:40:41.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83312024-10-01T02:40:41.042ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83322024-10-01T02:40:41.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83332024-10-01T02:40:41.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83342024-10-01T02:40:41.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83352024-10-01T02:40:41.044ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83362024-10-01T02:40:41.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
83372024-10-01T02:40:41.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83382024-10-01T02:40:41.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83392024-10-01T02:40:41.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83402024-10-01T02:40:41.046ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83412024-10-01T02:40:41.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83422024-10-01T02:40:41.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83432024-10-01T02:40:41.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83442024-10-01T02:40:41.049ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83452024-10-01T02:40:41.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83462024-10-01T02:40:41.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83472024-10-01T02:40:41.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83482024-10-01T02:40:41.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.575128ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83492024-10-01T02:40:41.049ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83502024-10-01T02:40:41.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83512024-10-01T02:40:41.052ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83522024-10-01T02:40:41.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83532024-10-01T02:40:41.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83542024-10-01T02:40:41.053ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1694, tv_nsec: 493160920 } })
83552024-10-01T02:40:41.054ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
83562024-10-01T02:40:41.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
83572024-10-01T02:40:41.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83582024-10-01T02:40:41.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83592024-10-01T02:40:41.058ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83602024-10-01T02:40:41.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83612024-10-01T02:40:41.061ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83622024-10-01T02:40:41.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83632024-10-01T02:40:41.082ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
83642024-10-01T02:40:41.082ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.984088ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
83652024-10-01T02:40:41.090ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83662024-10-01T02:40:41.090ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
83672024-10-01T02:40:41.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83682024-10-01T02:40:41.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83692024-10-01T02:40:41.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83702024-10-01T02:40:41.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.934111ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
83712024-10-01T02:40:41.093ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83722024-10-01T02:40:41.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83732024-10-01T02:40:41.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83742024-10-01T02:40:41.099ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83752024-10-01T02:40:41.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83762024-10-01T02:40:41.099ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 63.611656ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
83772024-10-01T02:40:41.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83782024-10-01T02:40:41.110ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83792024-10-01T02:40:41.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83802024-10-01T02:40:41.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
83812024-10-01T02:40:41.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83822024-10-01T02:40:41.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83832024-10-01T02:40:41.111ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
83842024-10-01T02:40:41.111ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83852024-10-01T02:40:41.112ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "11d1e363-aa47-4db2-a21a-5329f4af3296", "content-length": "26", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
83862024-10-01T02:40:41.112ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83872024-10-01T02:40:41.114ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
83882024-10-01T02:40:41.114ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 78.187041ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
83892024-10-01T02:40:41.114ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83902024-10-01T02:40:41.114ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.134379ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
83912024-10-01T02:40:41.115ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
83922024-10-01T02:40:41.115ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83932024-10-01T02:40:41.115ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "385bef4d-3e83-495e-bee0-b3c73604d03e", "content-length": "26", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
83942024-10-01T02:40:41.115ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83952024-10-01T02:40:41.117ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83962024-10-01T02:40:41.117ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83972024-10-01T02:40:41.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83982024-10-01T02:40:41.135ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83992024-10-01T02:40:41.135ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
84002024-10-01T02:40:41.135ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84012024-10-01T02:40:41.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84022024-10-01T02:40:41.136ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
84032024-10-01T02:40:41.136ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84042024-10-01T02:40:41.137ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1e51eaa-0903-4b7f-be39-b6a0a2df0f1a", "content-length": "26", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
84052024-10-01T02:40:41.137ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84062024-10-01T02:40:41.139ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
84072024-10-01T02:40:41.142ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84082024-10-01T02:40:41.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84092024-10-01T02:40:41.144ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 107.727745ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84102024-10-01T02:40:41.145ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84112024-10-01T02:40:41.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84122024-10-01T02:40:41.146ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84132024-10-01T02:40:41.149ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
84142024-10-01T02:40:41.149ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84152024-10-01T02:40:41.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84162024-10-01T02:40:41.151ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 114.880515ms iteration = 16 status = 0
84172024-10-01T02:40:41.169ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84182024-10-01T02:40:41.169ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84192024-10-01T02:40:41.169ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 132.988209ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84202024-10-01T02:40:41.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84212024-10-01T02:40:41.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84222024-10-01T02:40:41.196ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 160.105383ms iteration = 18 status = {"physical_disks_added":0}
84232024-10-01T02:40:41.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84242024-10-01T02:40:41.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84252024-10-01T02:40:41.291ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84262024-10-01T02:40:41.291ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "59e62326-0107-4c64-86a5-5ce213c639ca", "content-length": "372", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
84272024-10-01T02:40:41.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84282024-10-01T02:40:41.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84292024-10-01T02:40:41.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84302024-10-01T02:40:41.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84312024-10-01T02:40:41.296ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84322024-10-01T02:40:41.297ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84332024-10-01T02:40:41.297ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84342024-10-01T02:40:41.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84352024-10-01T02:40:41.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84362024-10-01T02:40:41.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84372024-10-01T02:40:41.298ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84382024-10-01T02:40:41.300ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84392024-10-01T02:40:41.300ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84402024-10-01T02:40:41.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84412024-10-01T02:40:41.300ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84422024-10-01T02:40:41.301ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1c0e5852-e945-4be3-99fb-507bedb36ed0", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
84432024-10-01T02:40:41.302ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 266.222361ms iteration = 17 status = {}
84442024-10-01T02:40:41.343ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 308.664243ms iteration = 16 status = {}
84452024-10-01T02:40:41.352ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
84462024-10-01T02:40:41.353ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "174399fe-6101-4ec0-930e-9630e114b6f2", "content-length": "2", "date": "Tue, 01 Oct 2024 02:40:40 GMT"} })
84472024-10-01T02:40:41.354ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84482024-10-01T02:40:41.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84492024-10-01T02:40:41.355ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 320.807936ms iteration = 16 status = null
84502024-10-01T02:40:41.386ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
84512024-10-01T02:40:41.386ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fc72e6d-a762-44fa-ab87-ecb2bf1c1872", "content-length": "691", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
84522024-10-01T02:40:41.386ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
84532024-10-01T02:40:41.386ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
84542024-10-01T02:40:41.386ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
84552024-10-01T02:40:41.388ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 352.522747ms iteration = 17 status = {}
84562024-10-01T02:40:41.408ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84572024-10-01T02:40:41.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84582024-10-01T02:40:41.410ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
84592024-10-01T02:40:41.410ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84602024-10-01T02:40:41.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84612024-10-01T02:40:41.417ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
84622024-10-01T02:40:41.418ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc7c1185-c44e-4f4d-803d-946318c909b0", "content-length": "121", "date": "Tue, 01 Oct 2024 02:40:40 GMT"} })
84632024-10-01T02:40:41.418ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
84642024-10-01T02:40:41.418ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
84652024-10-01T02:40:41.419ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
84662024-10-01T02:40:41.419ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
84672024-10-01T02:40:41.419ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
84682024-10-01T02:40:41.419ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
84692024-10-01T02:40:41.419ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
84702024-10-01T02:40:41.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84712024-10-01T02:40:41.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84722024-10-01T02:40:41.420ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
84732024-10-01T02:40:41.420ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "01626876-99f4-467d-bfb5-cad81c5c6b2a", "content-length": "2", "date": "Tue, 01 Oct 2024 02:40:40 GMT"} })
84742024-10-01T02:40:41.420ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
84752024-10-01T02:40:41.420ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "133fc69f-5c41-4528-a267-75c3e1c3b6b9", "content-length": "52", "date": "Tue, 01 Oct 2024 02:40:40 GMT"} })
84762024-10-01T02:40:41.420ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
84772024-10-01T02:40:41.420ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
84782024-10-01T02:40:41.531ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6bba193e-e7fd-41f2-b115-9a43cbfdd974", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
84792024-10-01T02:40:41.531ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
84802024-10-01T02:40:41.531ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
84812024-10-01T02:40:41.532ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d70940f6-403c-4dcb-9406-d2cbd3338c6e", "content-length": "667", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
84822024-10-01T02:40:41.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84832024-10-01T02:40:41.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84842024-10-01T02:40:41.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84852024-10-01T02:40:41.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84862024-10-01T02:40:41.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84872024-10-01T02:40:41.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84882024-10-01T02:40:41.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84892024-10-01T02:40:41.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84902024-10-01T02:40:41.559ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 522.833881ms iteration = 16 status = {}
84912024-10-01T02:40:41.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8b795ec4-28df-4a4e-9d70-282a8e33b4fa roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
84922024-10-01T02:40:41.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8b795ec4-28df-4a4e-9d70-282a8e33b4fa resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
84932024-10-01T02:40:41.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2772 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 8b795ec4-28df-4a4e-9d70-282a8e33b4fa response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
84942024-10-01T02:40:41.872ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 476 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 0f079075-1e68-4f54-85bc-ca7d3710d217 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
84952024-10-01T02:40:42.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 80b553a1-74ed-415c-b48c-65497730d8eb roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
84962024-10-01T02:40:42.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 80b553a1-74ed-415c-b48c-65497730d8eb resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
84972024-10-01T02:40:42.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 80b553a1-74ed-415c-b48c-65497730d8eb response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
84982024-10-01T02:40:43.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5b19cb05-3971-4e5a-983f-d25566f54cf4 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
84992024-10-01T02:40:43.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5b19cb05-3971-4e5a-983f-d25566f54cf4 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85002024-10-01T02:40:43.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5b19cb05-3971-4e5a-983f-d25566f54cf4 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85012024-10-01T02:40:44.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0b490671-50c7-434b-9ec3-bb3631bd43bc roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85022024-10-01T02:40:44.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0b490671-50c7-434b-9ec3-bb3631bd43bc resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85032024-10-01T02:40:44.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2496 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0b490671-50c7-434b-9ec3-bb3631bd43bc response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85042024-10-01T02:40:45.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a89e2c47-25de-4e93-966c-be657121130a roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85052024-10-01T02:40:45.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a89e2c47-25de-4e93-966c-be657121130a resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85062024-10-01T02:40:45.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = a89e2c47-25de-4e93-966c-be657121130a response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85072024-10-01T02:40:46.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 986f1e3c-e93b-46ee-964d-4a1d39bbeb52 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85082024-10-01T02:40:46.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 986f1e3c-e93b-46ee-964d-4a1d39bbeb52 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85092024-10-01T02:40:46.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 986f1e3c-e93b-46ee-964d-4a1d39bbeb52 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85102024-10-01T02:40:47.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b9fb4f6e-4260-4f84-b592-170681710f9c roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85112024-10-01T02:40:47.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b9fb4f6e-4260-4f84-b592-170681710f9c resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85122024-10-01T02:40:47.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = b9fb4f6e-4260-4f84-b592-170681710f9c response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85132024-10-01T02:40:48.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9ed8847e-9d09-4bd4-a219-22ff56db5774 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85142024-10-01T02:40:48.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9ed8847e-9d09-4bd4-a219-22ff56db5774 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85152024-10-01T02:40:48.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2887 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9ed8847e-9d09-4bd4-a219-22ff56db5774 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85162024-10-01T02:40:49.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 97999574-36f0-4720-9e9b-cf5275c16dae roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85172024-10-01T02:40:49.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 97999574-36f0-4720-9e9b-cf5275c16dae resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85182024-10-01T02:40:49.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 97999574-36f0-4720-9e9b-cf5275c16dae response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85192024-10-01T02:40:50.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3c3204e3-a39a-436a-9ddf-815cc0d8c8bb roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85202024-10-01T02:40:50.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3c3204e3-a39a-436a-9ddf-815cc0d8c8bb resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85212024-10-01T02:40:50.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 3c3204e3-a39a-436a-9ddf-815cc0d8c8bb response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85222024-10-01T02:40:51.035ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
85232024-10-01T02:40:51.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85242024-10-01T02:40:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85252024-10-01T02:40:51.036ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
85262024-10-01T02:40:51.036ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85272024-10-01T02:40:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85282024-10-01T02:40:51.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85292024-10-01T02:40:51.039ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85302024-10-01T02:40:51.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85312024-10-01T02:40:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85322024-10-01T02:40:51.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85332024-10-01T02:40:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85342024-10-01T02:40:51.040ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.609508ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85352024-10-01T02:40:51.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85362024-10-01T02:40:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85372024-10-01T02:40:51.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85382024-10-01T02:40:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
85392024-10-01T02:40:51.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85402024-10-01T02:40:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85412024-10-01T02:40:51.052ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
85422024-10-01T02:40:51.052ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.965324ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
85432024-10-01T02:40:51.872ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 442 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 75c188d8-17ed-4c69-baba-ec6d1c95d1e4 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
85442024-10-01T02:40:51.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 99d576e4-1444-4168-be14-8c7ac2de38ca roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85452024-10-01T02:40:51.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 99d576e4-1444-4168-be14-8c7ac2de38ca resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85462024-10-01T02:40:51.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 99d576e4-1444-4168-be14-8c7ac2de38ca response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85472024-10-01T02:40:52.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 40877681-23ee-46d2-81a6-5b10c46bb063 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85482024-10-01T02:40:52.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 40877681-23ee-46d2-81a6-5b10c46bb063 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85492024-10-01T02:40:52.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 40877681-23ee-46d2-81a6-5b10c46bb063 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85502024-10-01T02:40:53.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6b0197cf-02bd-4a8f-b048-5560972a1248 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85512024-10-01T02:40:53.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6b0197cf-02bd-4a8f-b048-5560972a1248 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85522024-10-01T02:40:53.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2724 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6b0197cf-02bd-4a8f-b048-5560972a1248 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85532024-10-01T02:40:54.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 84c2cfcb-41f6-4bd8-a108-97dfe59ce703 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85542024-10-01T02:40:54.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 84c2cfcb-41f6-4bd8-a108-97dfe59ce703 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85552024-10-01T02:40:54.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2820 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 84c2cfcb-41f6-4bd8-a108-97dfe59ce703 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85562024-10-01T02:40:55.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7acb58ea-60e2-4380-9b37-526dc64efb1f roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85572024-10-01T02:40:55.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7acb58ea-60e2-4380-9b37-526dc64efb1f resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85582024-10-01T02:40:55.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 7acb58ea-60e2-4380-9b37-526dc64efb1f response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85592024-10-01T02:40:57.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0adad95b-a134-445d-a803-1be152165bf8 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85602024-10-01T02:40:57.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0adad95b-a134-445d-a803-1be152165bf8 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85612024-10-01T02:40:57.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0adad95b-a134-445d-a803-1be152165bf8 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85622024-10-01T02:40:58.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5084f26b-8be2-4ccb-99fb-d6b1bc891ac0 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85632024-10-01T02:40:58.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5084f26b-8be2-4ccb-99fb-d6b1bc891ac0 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85642024-10-01T02:40:58.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 5084f26b-8be2-4ccb-99fb-d6b1bc891ac0 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85652024-10-01T02:40:59.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 872221f8-efe5-4a0d-9492-d6e6a60ea7a6 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85662024-10-01T02:40:59.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 872221f8-efe5-4a0d-9492-d6e6a60ea7a6 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85672024-10-01T02:40:59.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2714 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 872221f8-efe5-4a0d-9492-d6e6a60ea7a6 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85682024-10-01T02:41:00.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 06c6e076-8755-469c-b921-1d82d2e85c0e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85692024-10-01T02:41:00.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 06c6e076-8755-469c-b921-1d82d2e85c0e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85702024-10-01T02:41:00.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 06c6e076-8755-469c-b921-1d82d2e85c0e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85712024-10-01T02:41:01.035ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
85722024-10-01T02:41:01.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85732024-10-01T02:41:01.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85742024-10-01T02:41:01.036ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
85752024-10-01T02:41:01.036ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85762024-10-01T02:41:01.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85772024-10-01T02:41:01.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85782024-10-01T02:41:01.039ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85792024-10-01T02:41:01.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85802024-10-01T02:41:01.040ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.094818ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85812024-10-01T02:41:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85822024-10-01T02:41:01.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85832024-10-01T02:41:01.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85842024-10-01T02:41:01.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85852024-10-01T02:41:01.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85862024-10-01T02:41:01.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85872024-10-01T02:41:01.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
85882024-10-01T02:41:01.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85892024-10-01T02:41:01.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85902024-10-01T02:41:01.053ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
85912024-10-01T02:41:01.053ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.409462ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
85922024-10-01T02:41:01.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fdfce443-16f0-43f1-8a60-319f2839a37e roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85932024-10-01T02:41:01.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fdfce443-16f0-43f1-8a60-319f2839a37e resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85942024-10-01T02:41:01.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = fdfce443-16f0-43f1-8a60-319f2839a37e response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85952024-10-01T02:41:01.872ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 630 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 97d45a4a-7ea9-4bc4-b04f-b57319433fb4 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
85962024-10-01T02:41:02.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 61b78bc0-8a85-4dbe-9d7b-b95bf8ee6ac7 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85972024-10-01T02:41:02.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 61b78bc0-8a85-4dbe-9d7b-b95bf8ee6ac7 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85982024-10-01T02:41:02.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 61b78bc0-8a85-4dbe-9d7b-b95bf8ee6ac7 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
85992024-10-01T02:41:03.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9d870850-2e0c-4eea-926d-22628b5e14f4 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86002024-10-01T02:41:03.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9d870850-2e0c-4eea-926d-22628b5e14f4 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86012024-10-01T02:41:03.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 9d870850-2e0c-4eea-926d-22628b5e14f4 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86022024-10-01T02:41:04.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 843fd411-801c-48e7-b72c-4c0039cdc17c roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86032024-10-01T02:41:04.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 843fd411-801c-48e7-b72c-4c0039cdc17c resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86042024-10-01T02:41:04.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 843fd411-801c-48e7-b72c-4c0039cdc17c response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86052024-10-01T02:41:05.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 20c2c0bb-9308-45fb-9e0e-4cb0e2f0b478 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86062024-10-01T02:41:05.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 20c2c0bb-9308-45fb-9e0e-4cb0e2f0b478 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86072024-10-01T02:41:05.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 20c2c0bb-9308-45fb-9e0e-4cb0e2f0b478 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86082024-10-01T02:41:06.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 387a3a62-96cc-40ee-a418-2881b4120e4a roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86092024-10-01T02:41:06.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 387a3a62-96cc-40ee-a418-2881b4120e4a resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86102024-10-01T02:41:06.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 387a3a62-96cc-40ee-a418-2881b4120e4a response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86112024-10-01T02:41:07.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 37e49d13-300b-47d0-be92-cf6e043697eb roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86122024-10-01T02:41:07.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 37e49d13-300b-47d0-be92-cf6e043697eb resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86132024-10-01T02:41:07.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 37e49d13-300b-47d0-be92-cf6e043697eb response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86142024-10-01T02:41:08.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2137b84b-1235-48ba-abc6-63a02b7f3c78 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86152024-10-01T02:41:08.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2137b84b-1235-48ba-abc6-63a02b7f3c78 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86162024-10-01T02:41:08.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2546 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 2137b84b-1235-48ba-abc6-63a02b7f3c78 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86172024-10-01T02:41:09.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 985b9838-ee6f-4eaf-b442-02530c0d7419 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86182024-10-01T02:41:09.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 985b9838-ee6f-4eaf-b442-02530c0d7419 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86192024-10-01T02:41:09.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 985b9838-ee6f-4eaf-b442-02530c0d7419 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86202024-10-01T02:41:10.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6b157950-9860-47d5-9600-dd2326a874ce roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86212024-10-01T02:41:10.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6b157950-9860-47d5-9600-dd2326a874ce resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86222024-10-01T02:41:10.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 6b157950-9860-47d5-9600-dd2326a874ce response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
86232024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
86242024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86252024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
86262024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
86272024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
86282024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86292024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
86302024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86312024-10-01T02:41:11.035ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07
86322024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
86332024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 27.301\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07"}
86342024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
86352024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
86362024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86372024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
86382024-10-01T02:41:11.035ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-01 02:31:11.035345152 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
86392024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
86402024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
86412024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
86422024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
86432024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
86442024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86452024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
86462024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
86472024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
86482024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86492024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86502024-10-01T02:41:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86512024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
86522024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86532024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
86542024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86552024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
86562024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
86572024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
86582024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86592024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
86602024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86612024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
86622024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86632024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
86642024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
86652024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
86662024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86672024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
86682024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
86692024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
86702024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
86712024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86722024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
86732024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
86742024-10-01T02:41:11.036ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1724, tv_nsec: 475227160 } })
86752024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
86762024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
86772024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
86782024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86792024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
86802024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86812024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
86822024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
86832024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
86842024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86852024-10-01T02:41:11.036ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
86862024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86872024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
86882024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
86892024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86902024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
86912024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86922024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
86932024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
86942024-10-01T02:41:11.036ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1724, tv_nsec: 475757529 } })
86952024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86962024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86972024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86982024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
86992024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
87002024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
87012024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87022024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87032024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87042024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
87052024-10-01T02:41:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87062024-10-01T02:41:11.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87072024-10-01T02:41:11.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87082024-10-01T02:41:11.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87092024-10-01T02:41:11.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87102024-10-01T02:41:11.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87112024-10-01T02:41:11.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87122024-10-01T02:41:11.038ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
87132024-10-01T02:41:11.038ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.002641ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
87142024-10-01T02:41:11.038ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
87152024-10-01T02:41:11.038ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.078511ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
87162024-10-01T02:41:11.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87172024-10-01T02:41:11.039ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1724, tv_nsec: 478140249 } })
87182024-10-01T02:41:11.039ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.111149ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
87192024-10-01T02:41:11.039ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
87202024-10-01T02:41:11.040ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87212024-10-01T02:41:11.040ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-01 02:31:11.035345152 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
87222024-10-01T02:41:11.040ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.842941ms iteration = 9 status = {"expiration":"2024-10-01T02:31:11.035345152Z","pruned":[]}
87232024-10-01T02:41:11.041ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1724, tv_nsec: 480497858 } })
87242024-10-01T02:41:11.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87252024-10-01T02:41:11.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87262024-10-01T02:41:11.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87272024-10-01T02:41:11.042ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
87282024-10-01T02:41:11.042ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
87292024-10-01T02:41:11.042ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87302024-10-01T02:41:11.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87312024-10-01T02:41:11.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87322024-10-01T02:41:11.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87332024-10-01T02:41:11.044ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87342024-10-01T02:41:11.044ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87352024-10-01T02:41:11.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87362024-10-01T02:41:11.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87372024-10-01T02:41:11.046ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87382024-10-01T02:41:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87392024-10-01T02:41:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
87402024-10-01T02:41:11.047ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87412024-10-01T02:41:11.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87422024-10-01T02:41:11.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87432024-10-01T02:41:11.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87442024-10-01T02:41:11.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87452024-10-01T02:41:11.050ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.614054ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
87462024-10-01T02:41:11.051ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87472024-10-01T02:41:11.051ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
87482024-10-01T02:41:11.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87492024-10-01T02:41:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87502024-10-01T02:41:11.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87512024-10-01T02:41:11.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
87522024-10-01T02:41:11.055ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87532024-10-01T02:41:11.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87542024-10-01T02:41:11.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87552024-10-01T02:41:11.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87562024-10-01T02:41:11.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87572024-10-01T02:41:11.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
87582024-10-01T02:41:11.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87592024-10-01T02:41:11.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87602024-10-01T02:41:11.064ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87612024-10-01T02:41:11.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87622024-10-01T02:41:11.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87632024-10-01T02:41:11.068ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87642024-10-01T02:41:11.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87652024-10-01T02:41:11.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87662024-10-01T02:41:11.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87672024-10-01T02:41:11.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87682024-10-01T02:41:11.074ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87692024-10-01T02:41:11.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87702024-10-01T02:41:11.076ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1724, tv_nsec: 515133139 } })
87712024-10-01T02:41:11.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87722024-10-01T02:41:11.077ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
87732024-10-01T02:41:11.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
87742024-10-01T02:41:11.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87752024-10-01T02:41:11.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87762024-10-01T02:41:11.083ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.935887ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
87772024-10-01T02:41:11.083ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
87782024-10-01T02:41:11.083ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 47.787841ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
87792024-10-01T02:41:11.100ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87802024-10-01T02:41:11.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
87812024-10-01T02:41:11.105ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87822024-10-01T02:41:11.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87832024-10-01T02:41:11.106ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87842024-10-01T02:41:11.107ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87852024-10-01T02:41:11.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87862024-10-01T02:41:11.107ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 71.374326ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
87872024-10-01T02:41:11.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87882024-10-01T02:41:11.109ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87892024-10-01T02:41:11.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87902024-10-01T02:41:11.112ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87912024-10-01T02:41:11.112ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 76.006794ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87922024-10-01T02:41:11.113ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87932024-10-01T02:41:11.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87942024-10-01T02:41:11.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
87952024-10-01T02:41:11.118ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87962024-10-01T02:41:11.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87972024-10-01T02:41:11.120ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
87982024-10-01T02:41:11.121ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.766997ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
87992024-10-01T02:41:11.123ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88002024-10-01T02:41:11.125ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
88012024-10-01T02:41:11.125ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
88022024-10-01T02:41:11.125ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 89.236755ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
88032024-10-01T02:41:11.125ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88042024-10-01T02:41:11.125ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
88052024-10-01T02:41:11.125ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88062024-10-01T02:41:11.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88072024-10-01T02:41:11.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88082024-10-01T02:41:11.135ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88092024-10-01T02:41:11.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88102024-10-01T02:41:11.137ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88112024-10-01T02:41:11.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88122024-10-01T02:41:11.139ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88132024-10-01T02:41:11.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88142024-10-01T02:41:11.149ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88152024-10-01T02:41:11.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88162024-10-01T02:41:11.151ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88172024-10-01T02:41:11.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88182024-10-01T02:41:11.153ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88192024-10-01T02:41:11.157ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
88202024-10-01T02:41:11.157ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
88212024-10-01T02:41:11.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88222024-10-01T02:41:11.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88232024-10-01T02:41:11.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88242024-10-01T02:41:11.159ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88252024-10-01T02:41:11.160ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88262024-10-01T02:41:11.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88272024-10-01T02:41:11.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88282024-10-01T02:41:11.160ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
88292024-10-01T02:41:11.160ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 124.326383ms iteration = 17 status = 0
88302024-10-01T02:41:11.167ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88312024-10-01T02:41:11.167ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
88322024-10-01T02:41:11.167ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 130.888924ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
88332024-10-01T02:41:11.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 131.188969ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88342024-10-01T02:41:11.167ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88352024-10-01T02:41:11.168ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
88362024-10-01T02:41:11.168ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
88372024-10-01T02:41:11.168ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 132.393679ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
88382024-10-01T02:41:11.169ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
88392024-10-01T02:41:11.169ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88402024-10-01T02:41:11.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88412024-10-01T02:41:11.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 136.469657ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
88422024-10-01T02:41:11.182ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
88432024-10-01T02:41:11.182ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
88442024-10-01T02:41:11.182ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
88452024-10-01T02:41:11.182ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88462024-10-01T02:41:11.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88472024-10-01T02:41:11.184ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-01T02:33:09.142901Z, time_modified: 2024-10-01T02:33:09.142901Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }) }
88482024-10-01T02:41:11.184ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 148.992797ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]}},"default_endpoint":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
88492024-10-01T02:41:11.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88502024-10-01T02:41:11.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88512024-10-01T02:41:11.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88522024-10-01T02:41:11.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88532024-10-01T02:41:11.190ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
88542024-10-01T02:41:11.190ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
88552024-10-01T02:41:11.190ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
88562024-10-01T02:41:11.190ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88572024-10-01T02:41:11.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88582024-10-01T02:41:11.192ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
88592024-10-01T02:41:11.192ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
88602024-10-01T02:41:11.192ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88612024-10-01T02:41:11.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88622024-10-01T02:41:11.192ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88632024-10-01T02:41:11.192ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 156.33182ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
88642024-10-01T02:41:11.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88652024-10-01T02:41:11.197ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88662024-10-01T02:41:11.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88672024-10-01T02:41:11.197ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88682024-10-01T02:41:11.200ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
88692024-10-01T02:41:11.200ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 0 version = 2
88702024-10-01T02:41:11.200ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88712024-10-01T02:41:11.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88722024-10-01T02:41:11.201ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88732024-10-01T02:41:11.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88742024-10-01T02:41:11.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88752024-10-01T02:41:11.202ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88762024-10-01T02:41:11.203ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
88772024-10-01T02:41:11.203ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
88782024-10-01T02:41:11.203ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-01 02:33:12.369795 UTC dns_group = internal generation = 1
88792024-10-01T02:41:11.203ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 168.174728ms iteration = 9 status = {"generation":1}
88802024-10-01T02:41:11.205ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88812024-10-01T02:41:11.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88822024-10-01T02:41:11.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88832024-10-01T02:41:11.209ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 1 version = 2
88842024-10-01T02:41:11.209ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
88852024-10-01T02:41:11.210ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-01 02:33:13.765844 UTC dns_group = external generation = 2
88862024-10-01T02:41:11.210ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 174.548625ms iteration = 9 status = {"generation":2}
88872024-10-01T02:41:11.218ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88882024-10-01T02:41:11.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88892024-10-01T02:41:11.219ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
88902024-10-01T02:41:11.226ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
88912024-10-01T02:41:11.226ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88922024-10-01T02:41:11.227ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f97e1e1-eb2a-47c2-8ed0-e47e87ce039a", "content-length": "26", "date": "Tue, 01 Oct 2024 02:41:11 GMT"} })
88932024-10-01T02:41:11.228ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88942024-10-01T02:41:11.229ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88952024-10-01T02:41:11.231ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
88962024-10-01T02:41:11.231ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88972024-10-01T02:41:11.231ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2dafe74-98e2-4ddf-8fb9-be6edbcaf8f1", "content-length": "26", "date": "Tue, 01 Oct 2024 02:41:11 GMT"} })
88982024-10-01T02:41:11.231ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88992024-10-01T02:41:11.233ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89002024-10-01T02:41:11.238ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
89012024-10-01T02:41:11.238ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 202.815058ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
89022024-10-01T02:41:11.240ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
89032024-10-01T02:41:11.240ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89042024-10-01T02:41:11.240ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "875adda1-3785-4743-932b-be9cd18f1b9b", "content-length": "26", "date": "Tue, 01 Oct 2024 02:41:11 GMT"} })
89052024-10-01T02:41:11.240ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89062024-10-01T02:41:11.242ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
89072024-10-01T02:41:11.257ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 220.956673ms iteration = 19 status = {"physical_disks_added":0}
89082024-10-01T02:41:11.314ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
89092024-10-01T02:41:11.314ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "59b6ca10-41c3-4600-88ae-561498f7aeda", "date": "Tue, 01 Oct 2024 02:41:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89102024-10-01T02:41:11.314ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89112024-10-01T02:41:11.316ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "cb05de19-698f-4c7e-b2f0-286908e28889", "date": "Tue, 01 Oct 2024 02:41:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89122024-10-01T02:41:11.316ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89132024-10-01T02:41:11.318ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89142024-10-01T02:41:11.318ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 283.158025ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
89152024-10-01T02:41:11.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0980f711-2ce3-4846-816d-39bea65420ef roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
89162024-10-01T02:41:11.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0980f711-2ce3-4846-816d-39bea65420ef resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
89172024-10-01T02:41:11.349ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89182024-10-01T02:41:11.350ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7189e308-31d2-4f90-8a06-084b074e9cb4", "content-length": "372", "date": "Tue, 01 Oct 2024 02:41:11 GMT"} })
89192024-10-01T02:41:11.350ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89202024-10-01T02:41:11.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89212024-10-01T02:41:11.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 15283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 0980f711-2ce3-4846-816d-39bea65420ef response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
89222024-10-01T02:41:11.353ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89232024-10-01T02:41:11.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89242024-10-01T02:41:11.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89252024-10-01T02:41:11.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89262024-10-01T02:41:11.359ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89272024-10-01T02:41:11.362ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fe2af259-5b19-4169-b340-8749f7704d22", "date": "Tue, 01 Oct 2024 02:41:11 GMT"} })
89282024-10-01T02:41:11.364ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 328.442614ms iteration = 18 status = {}
89292024-10-01T02:41:11.372ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
89302024-10-01T02:41:11.383ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89312024-10-01T02:41:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89322024-10-01T02:41:11.385ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89332024-10-01T02:41:11.385ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
89342024-10-01T02:41:11.385ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfac8afc-7a38-4af7-9c0a-955183032ec6", "content-length": "2", "date": "Tue, 01 Oct 2024 02:41:10 GMT"} })
89352024-10-01T02:41:11.386ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89362024-10-01T02:41:11.386ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89372024-10-01T02:41:11.386ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89382024-10-01T02:41:11.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89392024-10-01T02:41:11.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89402024-10-01T02:41:11.388ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89412024-10-01T02:41:11.389ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 353.982191ms iteration = 17 status = null
89422024-10-01T02:41:11.390ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89432024-10-01T02:41:11.390ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89442024-10-01T02:41:11.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89452024-10-01T02:41:11.488ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 453.126703ms iteration = 17 status = {}
89462024-10-01T02:41:11.497ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
89472024-10-01T02:41:11.498ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8881d61c-a554-4c1d-a7ab-38b24fdf5b3e", "date": "Tue, 01 Oct 2024 02:41:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
89482024-10-01T02:41:11.498ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
89492024-10-01T02:41:11.500ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3a7e8f96-dd69-4db4-acba-44b6cf060d5a", "date": "Tue, 01 Oct 2024 02:41:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
89502024-10-01T02:41:11.500ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
89512024-10-01T02:41:11.502ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5b052ffa-3920-407e-92c5-0b8a365912f1", "date": "Tue, 01 Oct 2024 02:41:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
89522024-10-01T02:41:11.502ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
89532024-10-01T02:41:11.503ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
89542024-10-01T02:41:11.503ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 468.416389ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
89552024-10-01T02:41:11.510ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
89562024-10-01T02:41:11.511ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfe56d93-7d2d-45fe-8f57-1c8af10f91e2", "content-length": "691", "date": "Tue, 01 Oct 2024 02:41:11 GMT"} })
89572024-10-01T02:41:11.511ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
89582024-10-01T02:41:11.511ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
89592024-10-01T02:41:11.511ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
89602024-10-01T02:41:11.512ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 476.20438ms iteration = 18 status = {}
89612024-10-01T02:41:11.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89622024-10-01T02:41:11.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89632024-10-01T02:41:11.582ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
89642024-10-01T02:41:11.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89652024-10-01T02:41:11.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89662024-10-01T02:41:11.593ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
89672024-10-01T02:41:11.593ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebea1542-4087-469a-bfc3-b3a70d5e4060", "content-length": "121", "date": "Tue, 01 Oct 2024 02:41:11 GMT"} })
89682024-10-01T02:41:11.593ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
89692024-10-01T02:41:11.593ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
89702024-10-01T02:41:11.593ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
89712024-10-01T02:41:11.593ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
89722024-10-01T02:41:11.593ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
89732024-10-01T02:41:11.593ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
89742024-10-01T02:41:11.593ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
89752024-10-01T02:41:11.593ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89762024-10-01T02:41:11.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89772024-10-01T02:41:11.596ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
89782024-10-01T02:41:11.596ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6ab343e-9df8-4793-a17e-735011f77038", "content-length": "2", "date": "Tue, 01 Oct 2024 02:41:11 GMT"} })
89792024-10-01T02:41:11.596ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
89802024-10-01T02:41:11.597ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e633b14-d3b6-4255-adfd-5fa9c9d93239", "content-length": "52", "date": "Tue, 01 Oct 2024 02:41:11 GMT"} })
89812024-10-01T02:41:11.597ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
89822024-10-01T02:41:11.597ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
89832024-10-01T02:41:11.704ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ee0b0919-6997-4764-b83d-2c7f7d2dce8b", "date": "Tue, 01 Oct 2024 02:41:11 GMT"} })
89842024-10-01T02:41:11.704ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
89852024-10-01T02:41:11.704ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
89862024-10-01T02:41:11.708ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d937d64-e023-4ac6-9830-458cc955cc67", "content-length": "667", "date": "Tue, 01 Oct 2024 02:41:11 GMT"} })
89872024-10-01T02:41:11.708ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89882024-10-01T02:41:11.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89892024-10-01T02:41:11.712ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89902024-10-01T02:41:11.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89912024-10-01T02:41:11.715ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89922024-10-01T02:41:11.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89932024-10-01T02:41:11.717ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89942024-10-01T02:41:11.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89952024-10-01T02:41:11.725ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 688.788842ms iteration = 17 status = {}
89962024-10-01T02:41:11.872ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 468 local_addr = [fd00:1122:3344:101::b]:42426 method = GET remote_addr = [fd00:1122:3344:101::d]:63725 req_id = 386e159f-925e-4586-ad57-d85b050f4b99 response_code = 200 uri = /772acfa5-ee20-4a17-a053-c207ffa50ed6
89972024-10-01T02:41:12.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f6a87569-a2a5-47c1-98df-85fe92102935 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
89982024-10-01T02:41:12.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f6a87569-a2a5-47c1-98df-85fe92102935 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
89992024-10-01T02:41:12.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = f6a87569-a2a5-47c1-98df-85fe92102935 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
90002024-10-01T02:41:13.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 42de6802-3d70-4834-a4ce-80785e238532 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
90012024-10-01T02:41:13.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 42de6802-3d70-4834-a4ce-80785e238532 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
90022024-10-01T02:41:13.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 42de6802-3d70-4834-a4ce-80785e238532 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
90032024-10-01T02:41:14.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 46ba4f37-8352-4e93-bd42-dbe915e637c3 roles = RoleSet { roles: {} } uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
90042024-10-01T02:41:14.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 46ba4f37-8352-4e93-bd42-dbe915e637c3 resource = Database result = Ok(()) uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211
90052024-10-01T02:41:14.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45092 req_id = 46ba4f37-8352-4e93-bd42-dbe915e637c3 response_code = 200 uri = /probes/2a571ec0-85a3-450e-88fc-680c13ffa211